Image coding method, image decoding method, image coding apparatus, image decoding apparatus, and image coding and decoding apparatus

ABSTRACT

An image coding method includes: (i) determining, for each of one or more associated blocks, whether to add a motion vector of the associated block to a list, and (ii) adding the motion vector of the associated block to the list when determining that the motion vector of the associated block is to be added to the list; selecting, from the list, a motion vector which is to be merged to a current block; and (i) merging the selected motion vector to the current block, and (ii) coding the current block using the merged motion vector as a motion vector of the current block, and in the determining, it is determined that the motion vector of the associated block is not to be added to the list when an associated picture and an associated reference picture match temporally or when a current picture and a current reference picture match temporally.

CROSS REFERENCE TO RELATED APPLICATION

The present application claims the benefit of U.S. Provisional PatentApplication No. 61/502,391 filed Jun. 29, 2011. The entire disclosuresof the above-identified application, including the specification,drawings and claims are incorporated herein by reference in theirentirety.

TECHNICAL FIELD

One or more exemplary embodiments disclosed herein relate generally toimage coding methods of coding a plurality of blocks included in aplurality of pictures of an image.

BACKGROUND ART

As conventional techniques related to the image coding methods of codinga plurality of blocks included in a plurality of pictures of an image,some techniques are disclosed by Non Patent Literature 1 and Non PatentLiterature 2.

CITATION LIST Non Patent Literature

-   [Non Patent Literature 1] ITU-T Recommendation H. 264 “Advanced    video coding for generic audiovisual services” March, 2010-   [Non Patent Literature 2] JCT-VC “WD3: Working Draft 3 of    High-Efficiency Video Coding” JCTVC-E603, March, 2011

SUMMARY OF INVENTION Technical Problem

However, with the techniques disclosed by Non Patent Literature 1 andNon Patent Literature 2, there is a possibility that an image is notappropriately coded.

Thus, one or more exemplary embodiments provide an image coding methodin which an image can be appropriately coded.

Solution to Problem

In one general aspect, the techniques disclosed here feature an imagecoding method of coding a plurality of blocks included in a plurality ofpictures of an image, the image coding method comprising: (i)determining, for each of one or more associated blocks, whether or notto add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) coding the currentblock using the merged motion vector as a motion vector of the currentblock, wherein, in the determining, it is determined that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block in codingof the associated block, the current picture being a picture includingthe current block, and the current reference picture being a picturewhich is referred to using the motion vector of the current block in thecoding of the current block.

It is to be noted that these general or specific aspects may beimplemented using a device, system, an integrated circuit, a computerprogram, or a non-transitory recording medium such as acomputer-readable compact disc read-only memory (CD-ROM) and may also beimplemented using any combination of such device, system, integratedcircuit, computer program, and recording medium.

Advantageous Effects of Invention

According to the present disclosure, images are appropriately coded.

BRIEF DESCRIPTION OF DRAWINGS

These and other objects, advantages and features of the invention willbecome apparent from the following description thereof taken inconjunction with the accompanying drawings that illustrate a specificembodiment of the present invention.

FIG. 1 shows a typical reference picture list.

FIG. 2 shows a typical temporal direct mode.

FIG. 3 shows relationships between a current block and neighboringblocks.

FIG. 4 shows a list which contains candidate merge vectors.

FIG. 5 shows an operation of a typical image coding apparatus.

FIG. 6 shows an operation of a typical image decoding apparatus.

FIG. 7 shows a configuration of an image coding apparatus according toEmbodiment 1.

FIG. 8 shows a configuration of main structural elements of the imagecoding apparatus according to Embodiment 1.

FIG. 9 shows a motion vector of a neighboring block according toEmbodiment 1.

FIG. 10 shows a motion vector of a co-located block according toEmbodiment 1.

FIG. 11 shows a first example of a scaling process according toEmbodiment 1.

FIG. 12 shows a second example of the scaling process according toEmbodiment 1.

FIG. 13 shows a first example of a reference relationship according toEmbodiment 1.

FIG. 14 shows a second example of the reference relationship accordingto Embodiment 1.

FIG. 15 shows a third example of the reference relationship according toEmbodiment 1.

FIG. 16 shows a fourth example of the reference relationship accordingto Embodiment 1.

FIG. 17 is a flowchart showing an operation of the image codingapparatus according to Embodiment 1.

FIG. 18 is a flowchart showing a detailed operation of the image codingapparatus according to Embodiment 1.

FIG. 19 is a flowchart showing a variation of the operation of the imagecoding apparatus according to Embodiment 1.

FIG. 20 shows a configuration of an image decoding apparatus accordingto Embodiment 1.

FIG. 21 shows a configuration of main structural elements of the imagedecoding apparatus according to Embodiment 1.

FIG. 22 is a flowchart showing an operation of the image decodingapparatus according to Embodiment 1.

FIG. 23 is a flowchart showing a detailed operation of the imagedecoding apparatus according to Embodiment 1.

FIG. 24 is a flowchart showing a variation of the operation of the imagedecoding apparatus according to Embodiment 1.

FIG. 25 shows a fifth example of the reference relationship according toEmbodiment 1.

FIG. 26 shows a sixth example of the reference relationship according toEmbodiment 1.

FIG. 27 shows an overall configuration of a content providing system forimplementing content distribution services.

FIG. 28 shows an overall configuration of a digital broadcasting system.

FIG. 29 shows a block diagram illustrating an example of a configurationof a television.

FIG. 30 shows a block diagram illustrating an example of a configurationof an information reproducing/recording unit that reads and writesinformation from and on a recording medium that is an optical disk.

FIG. 31 shows an example of a configuration of a recording medium thatis an optical disk.

FIG. 32A shows an example of a cellular phone.

FIG. 32B is a block diagram showing an example of a configuration of acellular phone.

FIG. 33 illustrates a structure of multiplexed data.

FIG. 34 schematically shows how each stream is multiplexed inmultiplexed data.

FIG. 35 shows how a video stream is stored in a stream of PES packets inmore detail.

FIG. 36 shows a structure of TS packets and source packets in themultiplexed data.

FIG. 37 shows a data structure of a PMT.

FIG. 38 shows an internal structure of multiplexed data information.

FIG. 39 shows an internal structure of stream attribute information.

FIG. 40 shows steps for identifying video data.

FIG. 41 is a block diagram showing an example of a configuration of anintegrated circuit for implementing the moving picture coding method andthe moving picture decoding method according to an embodiment.

FIG. 42 shows a configuration for switching between driving frequencies.

FIG. 43 shows steps for identifying video data and switching betweendriving frequencies.

FIG. 44 shows an example of a look-up table in which video datastandards are associated with driving frequencies.

FIG. 45A is a diagram showing an example of a configuration for sharinga module of a signal processing unit.

FIG. 45B is a diagram showing another example of a configuration forsharing a module of the signal processing unit.

DESCRIPTION OF EMBODIMENTS Underlying Knowledge Forming Basis of thePresent Disclosure

Generally, when coding moving pictures, an image coding apparatuscompresses the quantity of information by reducing redundancy of themoving pictures in spatial and temporal directions. At this time, theimage coding apparatus uses intra prediction (referred to also asintra-picture prediction) as a method of reducing the redundancy in thespatial direction. As a method of reducing the redundancy in thetemporal direction, the image coding apparatus uses inter prediction(referred to also as inter-picture prediction) as a method of reducingthe redundancy in the temporal direction.

For example, when coding a current picture in the inter prediction, theimage coding apparatus uses, as a reference picture, a coded picturelocated before or after the current picture in display order. The imagecoding apparatus then derives a motion vector through motion estimation.Using the motion vector, the image coding apparatus then performs motioncompensation to generate prediction image data. Subsequently, the imagecoding apparatus codes a difference between the generated predictionimage data and the image data of the current picture, thereby removingthe redundancy in the temporal direction.

Furthermore, in the motion estimation, the image coding apparatuscalculates a difference between a current block to be coded in thecurrent picture and a block in the reference picture. At this time, theimage coding apparatus determines, as a reference block, one of theblocks in the reference picture with which the difference is smallest.Using the current block and the reference block, the image codingapparatus then estimates a motion vector.

The image coding apparatus of H. 264 that is an already-standardizedmoving picture coding scheme (Non Patent Literature 1) uses three typesof pictures: I-picture, P-picture, and B-picture, to reduce the quantityof information.

The H. 264 image coding apparatus codes an I-picture using intraprediction. The image coding apparatus codes a P-picture using interprediction. When coding a P-picture, the image coding apparatus refersto one coded picture located before or after the P-picture in displayorder. In other words, the image coding apparatus codes a P-pictureusing uni-directional prediction.

The image coding apparatus codes a B-picture using inter prediction.When coding a B-picture, the image coding apparatus refers to two codedpictures located before or after the B-picture in display order. Inother words, the image coding apparatus codes a B-picture usingbi-directional prediction.

It is to be noted that the bi-directional prediction may only representpredicting image data with reference to one reference picture located ineach of before and after the B-picture. Furthermore, the bi-directionalprediction may include predicting image data with reference to tworeference pictures located in one of before and after the B-picture. Inthe latter case, the bi-direction prediction may be represented asbi-prediction.

In the inter prediction, the image coding apparatus generates areference picture list for specifying a reference picture. The imagecoding apparatus assigns, in the reference picture list, a referencepicture index to the reference picture which is referred to in the interprediction. In coding a B-picture, the image coding apparatus refers totwo pictures. Accordingly, the image coding apparatus holds tworeference picture lists L0 and L1.

FIG. 1 shows an example of the reference picture list. Reference picturelists L0 and L1 shown in FIG. 1 are an example of the two referencepicture lists in the bi-directional prediction.

The image coding apparatus assigns, in the reference picture list L0, areference picture index 0 to a reference picture which is the second indisplay order. Furthermore, the image coding apparatus assigns areference picture index 1 to a reference picture which is the first indisplay order. Furthermore, the image coding apparatus assigns areference picture index 2 to a reference picture which is the 0-th indisplay order. In short, the image coding apparatus assigns referencepicture indices in descending order of closeness, in display order, tothe current picture.

Meanwhile, the image coding apparatus assigns, in the reference picturelist L1, a reference picture index 0 to a reference picture which is thesecond in display order. Furthermore, the image coding apparatus assignsa reference picture index 2 to a reference picture which is the first indisplay order. Furthermore, the image coding apparatus assigns areference picture index 1 to a reference picture which is the 0-th indisplay order.

As such, the image coding apparatus may assign, for each referencepicture list, a different reference picture index to the same referencepicture. Alternatively, the image coding apparatus may assign the samereference picture index to the same reference picture.

In addition, it may be possible that the reference picture list L0correspond to a first prediction direction while the reference picturelist L1 correspond to a second prediction direction. Here, the firstprediction direction and the second prediction direction are differentfrom each other, one of which is forward and the other of which isbackward. Typically, the reference picture list L0 is used to specify areference picture which is located before the current picture in displayorder, and the reference picture list L1 is used to specify a referencepicture which is located after the current picture in display order.

Furthermore, the inter prediction has a plurality of coding modes forpredicting image data of the current block. In some cases, such codingmode indicates not only the inter prediction or the intra prediction,but a detailed mode which is included in the inter prediction or theintra prediction. The image coding apparatus selects, from among thecoding modes, a coding mode which is to be applied in the prediction ofimage data of the current block.

For example, the image coding apparatus selects, as the coding mode,bi-directional prediction in which a prediction image is generated withreference to two pictures located before or after the current picture indisplay order. Alternatively, for example, the image coding apparatusselects, as the coding mode, uni-directional prediction in which aprediction image is generated with reference to one picture locatedbefore or after the current picture in display order. Alternatively, theimage coding apparatus selects a coding mode called a temporal directmode.

FIG. 2 shows the temporal direct mode. FIG. 2 shows a case where thecurrent block in a picture B2 is coded using a motion vector obtained inthe temporal direct mode.

In this case, the image coding apparatus uses a motion vector vb used tocode a co-located block. The co-located block is included in a pictureP3 that is a reference picture located after the picture B2 in displayorder. Furthermore, the position of the co-located block agrees with theposition of the current block. The motion vector vb of the co-locatedblock points to a picture P1.

It is to be noted that the position of the co-located block does nothave to completely agree with the position of a block to be processed,such as the current block. For example, the upper left position of theco-located block may agree with the lower right position of the block tobe processed. In other words, the co-located block may be locatedspatially to the lower right of the block to be processed.

The image coding apparatus specifies two reference blocks for thecurrent block from both the picture P1 that is a preceding referencepicture, and the picture P3 that is a succeeding reference picture,using two motion vectors va1 and va2 parallel to the motion vector vb.The image coding apparatus then codes the current block in thebi-direction prediction.

Specifically, the image coding apparatus uses the motion vector va1 forthe picture P1 and the motion vector va2 for the picture P3. The imagecoding apparatus then specifies the two reference blocks and codes thecurrent block in the bi-directional prediction.

The two motion vectors va1 and va2 are parallel to the motion vector vb.The image coding apparatus scales the motion vector vb according to theratio of temporal distance among the three pictures P1, B2, and P3,thereby obtaining the two motion vectors va1 and va2.

In addition, a discussion has been made on using a merge mode at thetime of coding the motion vector of the current block in the B pictureor the P picture (Non Patent Literature 2). The image coding apparatuswhich uses the merge mode generates a plurality of candidate mergevectors from, for example, neighboring blocks that are adjacent to thecurrent block. The image coding apparatus then selects a merge vectorfrom among the plurality of candidates.

The image coding apparatus then codes the current block using theselected merge vector. Specifically, the image coding apparatus merges(copies) a motion vector from a neighboring block, which is adjacent tothe current block, to the current block, and codes the current blockusing the merged motion vector. The use of the motion vector of theneighboring block or the like allows the image coding apparatus toreduce a code amount and a calculation amount for the motion vector.

Furthermore, the image coding apparatus adds, to a bitstream, an indexof the selected merge vector (which is referred to also as a mergevector index or a merge block index). Thus, an image decoding apparatuscan select the same merge vector at the time of decoding.

FIG. 3 is a view for explaining the merge mode and shows therelationships between the current block and the neighboring blocks. InFIG. 3, a neighboring block A is a coded block which is adjacent to theleft of the current block, a neighboring block B is a coded block whichis adjacent to the top of the current block, a neighboring block C is acoded block which is adjacent to the upper right of the current block,and a neighboring block D is a coded block which is adjacent to thelower left of the current block.

The neighboring block A has a motion vector mvA. This means that theneighboring block A has been coded using the motion vector mvA. Theneighboring block B has a motion vector mvB. This means that theneighboring block B has been coded using the motion vector mvB. Theneighboring block C has been coded in the intra prediction. Thus, theneighboring block C has no motion vector. The neighboring block D has amotion vector mvD. This means that the neighboring block D has beencoded using the motion vector mvD.

The image coding apparatus selects a merge vector from among theplurality of motion vectors mvA, mvB, and mvD, and so on. In some cases,the image coding apparatus selects, as the merge vector, a motion vectorobtained in the temporal direct mode. The motion vector obtained in thetemporal direct mode originates from a co-located block of the currentblock.

The image coding apparatus selects, from among the plurality ofcandidates, the merge vector with which the current block can be mostefficiently coded. For example, the image coding apparatus selects, asthe merge vector, the candidate which points to a reference blockclosest to the current block. The image coding apparatus then adds, to abitstream, an index which indicates the selected merge vector.

More specifically, for example, when coding the motion vector of thecurrent block, the image coding apparatus selects the motion vector mvAof the neighboring block A as the merge vector. The image codingapparatus then adds, to the bitstream, one of a plurality of indexvalues which indicates that the motion vector mvA has been used. By sodoing, the image coding apparatus is capable of reducing the quantity ofinformation of the motion vector of the current block.

FIG. 4 shows an example of a list which contains candidate mergevectors. Furthermore, the image coding apparatus deletes, from the list,a candidate which cannot be used (hereinafter referred to as anunavailable candidate). Furthermore, the image coding apparatus deletes,from the list, a candidate which has the same value as other candidates(hereinafter referred to as a duplicate candidate). A decrease in thenumber of candidates leads to a decrease in the code amount of indices.

For example, when a neighboring block is a block coded in the intraprediction, the neighboring block has no motion vector. In this case,the image coding apparatus cannot obtain the merge vector from suchneighboring block. Thus, in this case, the image coding apparatusdeletes the candidate of such neighboring block from the list.

Furthermore, when a neighboring block is located outside a slice oroutside a picture, the image coding apparatus cannot obtain the mergevector from such neighboring block. Furthermore, when a neighboringblock has not yet been coded, the image coding apparatus cannot obtainthe merge vector from such neighboring block. In these cases, the imagecoding apparatus deletes the candidate of such neighboring block fromthe list.

In the example of FIG. 4, since the neighboring block C has been codedin the intra prediction, a candidate identified by the index value is anunavailable candidate. Accordingly, the image coding apparatus deletesthe candidate from the list.

Furthermore, the motion vector mvD of the neighboring block D agreeswith the motion vector mvA of the neighboring block A. Accordingly, acandidate identified by the index value 4 is deleted from the list.Ultimately, the number of candidates is 3.

FIG. 5 is a flowchart showing an operation of the image codingapparatus. First, the image coding apparatus adds a motion vector ofeach of a plurality of associated blocks to the list (S81). Theassociated block is a neighboring block, a co-located block, or thelike.

Next, the image coding apparatus deletes, from the list, a duplicatecandidate and an unavailable candidate (S82). Next, the image codingapparatus selects a merge vector from the list (S83). Next, the imagecoding apparatus codes an index assigned to the selected merge vector(S84).

FIG. 6 is a flowchart showing an operation of the image decodingapparatus. The image decoding apparatus adds a motion vector of each ofthe plurality of associated blocks to the list (S91).

Next, the image decoding apparatus deletes, from the list, a duplicatecandidate and an unavailable candidate (S92). Next, the image decodingapparatus decodes the index coded by the image coding apparatus (S93).The image decoding apparatus selects a merge vector based on the decodedindex (S94). The image decoding apparatus then decodes the current blockusing the selected merge vector.

However, in the conventional merge mode, the fact that a block is codedwith reference to a picture which temporally matches the block is nottaken into account. For example, the image coding apparatus which adoptsthe multiview video coding (MVC) may code a picture in a non-base viewwith reference to a picture in a base view. In this case, the twopictures in a reference relationship (the picture in the base view andthe picture in the non-base view) match temporally.

More specifically, in some cases, a co-located block is coded using areference picture, and the co-located block and the reference pictureare included in views different from each other. In such a case, theco-located block is coded using the reference picture which temporallymatches the co-located block.

In this case, since a temporal distance of the motion vector is 0, it isnot possible for the image coding apparatus to scale the motion vectorbased on the temporal distance. Thus, the image coding apparatus cannotobtain the motion vector obtained in the temporal direct mode. Thisrequires the image coding apparatus to switch the operation by a specialflag or the like when there is a possibility that a block is coded withreference to a picture which temporally matches the block. However,switching the operation by a special flag or the like is inefficientfrom the perspective of coding efficiency.

Therefore, the image coding method in which an image can beappropriately coded even when there is a possibility that a block iscoded with reference to a picture which temporally matches a pictureincluding the block contributes to the improvement of coding efficiency.

In one general aspect, the techniques disclosed here feature an imagecoding method of coding a plurality of blocks included in a plurality ofpictures of an image, the image coding method comprising: (i)determining, for each of one or more associated blocks, whether or notto add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) coding the currentblock using the merged motion vector as a motion vector of the currentblock, wherein, in the determining, it is determined that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block in codingof the associated block, the current picture being a picture includingthe current block, and the current reference picture being a picturewhich is referred to using the motion vector of the current block in thecoding of the current block.

By so doing, an image can be appropriately coded even when there is apossibility that a block is coded with reference to a picture whichtemporally matches a picture including the block.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen a view including the associated picture is different from a viewincluding the associated reference picture or when a view including thecurrent picture is different from a view including the current referencepicture, so as to determine that the motion vector of the associatedblock is not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current reference picture match temporally.

By so doing, an image can be appropriately coded even when there is apossibility that a block is coded with reference to a picture which isincluded in a view different from a view which includes the block.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen a display order of the associated picture and a display order ofthe associated reference picture match or when a display order of thecurrent picture and a display order of the current reference picturematch, so as to determine that the motion vector of the associated blockis not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current reference picture match temporally.

By so doing, an image can be appropriately coded even when there is apossibility that the display order of a picture which includes a blockand the display order of a reference picture for the block match.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen the associated picture and the associated reference picture matchtemporally or when the current picture and the current associatedreference picture match temporally except when the associated pictureand the associated reference picture match temporally and the currentpicture and the current reference picture match temporally.

By so doing, a motion vector which does not have to be scaled can beused as a candidate motion vector to be merged. Thus, images areappropriately coded.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen only one of the following is true: a view including the associatedpicture is different from a view including the associated referencepicture; and a view including the current picture is different from aview including the current reference picture, so as to determine thatthe motion vector of the associated block is not to be added to the listwhen the associated picture and the associated reference picture matchtemporally or when the current picture and the current reference picturematch temporally except when the associated picture and the associatedreference picture match temporally and the current picture and thecurrent reference picture match temporally.

By so doing, an image can be appropriately coded even when there is apossibility that only one of the current block and the associated blockis coded in inter-view prediction.

Furthermore, for example, in the adding, a predetermined motion vectormay be added to the list when the current picture and the currentreference picture match temporally.

By so doing, a predetermined motion vector is used as a candidate motionvector to be merged. This suppresses a reduction in the number ofcandidates.

Furthermore, for example, it may be possible that in the adding, thepredetermined motion vector which is attached to a header of a codedstream may be added to the list.

By so doing, in both the coding process and the decoding process, thesame motion vector can be added to the list. Thus, images areappropriately coded.

Furthermore, for example, in the adding, a disparity vector indicating adirection and a magnitude of disparity may be added to the list as thepredetermined motion vector.

By so doing, a disparity vector is used as a candidate motion vector tobe merged. When the current picture and the current reference picturematch temporally, inter-view prediction is likely to be used to code thecurrent block. In such a case, a disparity vector is used as a candidatemotion vector to be merged, with the result that images areappropriately coded.

Furthermore, for example, it may be possible that, in the coding, thecurrent block be coded using a motion vector resulting from motionestimation, and the motion vector resulting from the motion estimationbe coded when no motion vector is added to the list.

By so doing, even when there is no candidate motion vector to be merged,the motion vector is coded. Thus, images are appropriately coded.

Furthermore, for example, it may be possible that, in the adding, themotion vector of the associated block be scaled using a ratio of atemporal distance between the current picture and the current referencepicture to a temporal distance between the associated picture and theassociated reference picture, and the scaled motion vector be added tothe list.

By so doing, the motion vector of the associated block is scaled using atemporal distance. A scaled motion vector is then used as a candidatemotion vector to be merged, with the result that images areappropriately coded.

Furthermore, in one general aspect, the techniques disclosed herefeature an image decoding method of decoding a plurality of blocksincluded in a plurality of pictures of an image, the image decodingmethod comprising: (i) determining, for each of one or more associatedblocks, whether or not to add a motion vector of the associated block toa list, and (ii) adding the motion vector of the associated block to thelist when determining that the motion vector of the associated block isto be added to the list, the one or more associated blocks being one ormore blocks included in the plurality of blocks; selecting, from thelist, a motion vector which is to be merged to a current block that is ablock which is included in the plurality of blocks and is different fromthe one or more associated blocks; and (i) merging, to the currentblock, the motion vector selected in the selecting, and (ii) decodingthe current block using the merged motion vector as a motion vector ofthe current block, wherein, in the determining, it is determined thatthe motion vector of the associated block is not to be added to the listwhen an associated picture and an associated reference picture matchtemporally or when a current picture and a current reference picturematch temporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block indecoding of the associated block, the current picture being a pictureincluding the current block, and the current reference picture being apicture which is referred to using the motion vector of the currentblock in the decoding of the current block.

By so doing, an image can be appropriately decoded even when there is apossibility that a block is decoded with reference to a picture whichtemporally matches a picture including the block.

For example, in the determining, it may be determined that the motionvector of the associated block is not to be added to the list when aview including the associated picture is different from a view includingthe associated reference picture or when a view including the currentpicture is different from a view including the current referencepicture, so as to determine that the motion vector of the associatedblock is not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current reference picture match temporally.

By so doing, an image can be appropriately decoded even when there is apossibility that a block is decoded with reference to a picture which isincluded in a view different from a view which includes the block.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen a display order of the associated picture and a display order ofthe associated reference picture match or when a display order of thecurrent picture and a display order of the current reference picturematch, so as to determine that the motion vector of the associated blockis not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current reference picture match temporally.

By so doing, an image can be appropriately decoded even when there is apossibility that the display order of a picture which includes a blockand the display order of a reference picture for the block match.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen the associated picture and the associated reference picture matchtemporally or when the current picture and the current associatedreference picture match temporally except when the associated pictureand the associated reference picture match temporally and the currentpicture and the current reference picture match temporally.

By so doing, a motion vector which does not have to be scaled can beused as a candidate motion vector to be merged. Thus, images areappropriately decoded.

Furthermore, for example, in the determining, it may be determined thatthe motion vector of the associated block is not to be added to the listwhen only one of the following is true: a view including the associatedpicture is different from a view including the associated referencepicture; and a view including the current picture is different from aview including the current reference picture, so as to determine thatthe motion vector of the associated block is not to be added to the listwhen the associated picture and the associated reference picture matchtemporally or when the current picture and the current reference picturematch temporally except when the associated picture and the associatedreference picture match temporally and the current picture and thecurrent reference picture match temporally.

By so doing, an image can be appropriately decoded even when there is apossibility that only one of the current block and the associated blockis decoded in inter-view prediction.

Furthermore, for example, in the adding, a predetermined motion vectormay be added to the list when the current picture and the currentreference picture match temporally.

By so doing, a predetermined motion vector is used as a candidate motionvector to be merged. This suppresses a reduction in the number ofcandidates.

Furthermore, for example, in the adding, the predetermined motion vectorwhich has been attached to a header of a coded stream may be added tothe list.

By so doing, in both the coding process and the decoding process, thesame motion vector can be added to the list. Thus, images areappropriately decoded.

Furthermore, for example, in the adding, a disparity vector indicating adirection and a magnitude of disparity may be added to the list as thepredetermined motion vector.

By so doing, a disparity vector is used as a candidate motion vector tobe merged. When the current picture and the current reference picturematch temporally, inter-view prediction is likely to be used to decodethe current block. In such a case, a disparity vector is used as acandidate motion vector to be merged, with the result that images areappropriately decoded.

Furthermore, for example, it may be possible that, in the decoding, themotion vector of the current block be decoded, and the current block bedecoded using the decoded motion vector when no motion vector is addedto the list.

By so doing, even when there is no candidate motion vector to be merged,the motion vector is decoded. Thus, images are appropriately decoded.

Furthermore, for example, it may be possible that, in the adding, themotion vector of the associated block be scaled using a ratio of atemporal distance between the current picture and the current referencepicture to a temporal distance between the associated picture and theassociated reference picture, and the scaled motion vector be added tothe list.

By so doing, the motion vector of the associated block is scaled using atemporal distance. A scaled motion vector is then used as a candidatemotion vector to be merged, with the result that images areappropriately decoded.

Furthermore, these general or specific aspects may be implemented usinga device, system, an integrated circuit, a computer program, or anon-transitory recording medium such as a computer-readable compact discread-only memory (CD-ROM) and may also be implemented using anycombination of such device, system, integrated circuit, computerprogram, and recording medium.

Hereinafter, an image coding apparatus and an image decoding apparatusaccording to certain exemplary embodiments are described in greaterdetail with reference to the accompanying Drawings.

Each of the exemplary embodiments described below shows a general orspecific example. The numerical values, shapes, materials, structuralelements, the arrangement and connection of the structural elements,steps, the processing order of the steps etc. shown in the followingexemplary embodiments are mere examples, and therefore do not limit theinventive concept disclosed herein. Therefore, among the structuralelements in the following exemplary embodiments, structural elements notrecited in any one of the independent claims defining the most genericpart of the inventive concept are described as arbitrary structuralelements.

Here, a current block to be coded, a current block to be decoded, and acurrent block to be processed in the following exemplary embodiments areeach referred to also as a current block. Furthermore, a current pictureto be coded, a current picture to be decoded, and a current picture tobe processed are each referred to also as a current picture.

In addition, images in the following exemplary embodiments may be movingpictures, multiview video, a set of one or more pictures, and part of apicture.

A block in the following exemplary embodiments may be a block called acoding unit (CU), a block called a prediction unit (PU), a block calleda macroblock, and other blocks.

A motion vector in inter prediction has a direction and a magnitude andis different from a prediction direction in intra prediction.

Embodiment 1

FIG. 7 is a structural diagram showing an image coding apparatusaccording to this embodiment. The image coding apparatus shown in FIG. 7includes a coding unit 101, an inter prediction control unit 121, and apicture type determination unit 124. Furthermore, the coding unit 101includes a subtraction unit 102, an orthogonal transform unit 103, aquantization unit 104, a variable-length coding unit 105, an inversequantization unit 106, an inverse orthogonal transform unit 107, anaddition unit 108, a block memory 109, an intra prediction unit 110, aframe memory 111, an inter prediction unit 112, and a switch 113.

The subtraction unit 102 subtracts prediction image data from inputimage data and outputs prediction error data. The orthogonal transformunit 103 transforms the prediction error data from an image domain intoa frequency domain. The quantization unit 104 performs a quantizationprocess on the prediction error data transformed into the frequencydomain.

The inverse quantization unit 106 performs an inverse quantizationprocess on the prediction error data on which the quantization processhas been performed by the quantization unit 104. The inverse orthogonaltransform unit 107 transforms, from the frequency domain into the imagedomain, the prediction error data on which the inverse quantizationprocess has been performed. The addition unit 108 adds the predictionerror data and the prediction image data and outputs reconstructed imagedata. The block memory 109 is a memory for storing the reconstructedimage data on a per block basis. The frame memory 111 is a memory forstoring the reconstructed image data on a per frame basis.

The intra prediction unit 110 performs intra prediction using theper-block reconstructed image data stored in the block memory 109. By sodoing, the intra prediction unit 110 generates prediction image data fora current block to be coded. The inter prediction unit 112 performsinter prediction using the per-frame reconstructed image data stored inthe frame memory 111 and a motion vector derived from motion estimation.By so doing, the inter prediction unit 112 generates prediction imagedata for the current block. Alternatively, the inter prediction unit 112generates prediction image data using a merge vector. The switch 113switches a coding mode to the intra prediction or the inter prediction.

The picture type determination unit 124 determines which one of thefollowing pictures types: I-picture, B-picture, and P-picture, is to beused in coding the input image data, and generates picture typeinformation.

The inter prediction control unit 121 selects a merge vector from amongone or more candidates. Processing which is performed by the interprediction control unit 121 will be later described in detail.

The variable-length coding unit 105 performs a variable-length codingprocess on the prediction error data on which the quantization processhas been performed, an index which represents a merge vector, thepicture type information, and the like. By so doing, the variable-lengthcoding unit 105 generates a bitstream. It is to be noted that, when nomerge vector has been selected, the variable-length coding unit 105codes the motion vector derived from the motion estimation.

FIG. 7 is a structural diagram showing an example of the image codingapparatus according to this embodiment. A specific structural embodimentis not limited to the configuration shown in FIG. 7. For example, in thecase where the picture type is predetermined, the picture typedetermination unit 124 may be excluded. The coding unit 101 does notneed to include a plurality of structural elements. The coding unit 101may code an image without performing the frequency transform, thequantization, the inverse frequency transform, the inverse quantization,the intra prediction, or the like.

FIG. 8 shows a configuration of main structural elements of the imagecoding apparatus shown in FIG. 7. The image coding apparatus shown inFIG. 8 includes the coding unit 101 and the inter prediction controlunit 121. The inter prediction control unit 121 includes an additionunit 131 and a selection unit 132.

The addition unit 131 selectively adds a motion vector of each of one ormore associated blocks to a list. Specifically, the adding unit 131selects, for each of the one or more associated blocks, whether or notto add the motion vector of the associated block to the list, and adds,to the list, the motion vector selected as a motion vector to be added.The addition unit 131 may add all the one or more motion vectors of theone or more associated blocks to the list and may alternatively add partof the one or more motion vectors of the one or more associated blocksto the list.

The associated block is a coded neighboring block, a coded co-locatedblock, or the like. Specifically, the associated bock may be a blockwhich is included in the current picture and spatially adjacent to thecurrent block. Alternatively, the associated block may be a block whichis included in one or more pictures different from the current pictureand spatially matches or corresponds to the current block.

The selection unit 132 selects a merge vector from the list.Specifically, the selection unit 132 selects, as the merge vector, amotion vector which is used to code the motion vector of the currentblock.

The motion vector of the current block is referred to also as a currentmotion vector. The motion vector of the associated block, the motionvector of the neighboring block, and the motion vector of the co-locatedblock are referred to also as an associated motion vector, a neighboringmotion vector, and a co-located motion vector, respectively.

The coding unit 101 codes the current block using the merge vectorselected by the selection unit 132. Specifically, the coding unit 101merges, to the current block, the motion vector selected by theselection unit 132, and codes the current block using the merged motionvector.

By so doing, the image coding apparatus can select the merge vector fromthe list and use the merge vector to code the current block. Althoughthe addition unit 131 and the selection unit 132 are included in theinter prediction control unit 121 in FIG. 8, the addition unit 131 andthe selection unit 132 may be independent of the inter predictioncontrol unit 121. In this case, the inter prediction control unit 121does not have to be included in the image coding apparatus.

FIG. 9 shows a motion vector of a neighboring block according to thisembodiment. In FIG. 9, a plurality of pictures B0 to B4 are shown indisplay order.

A motion vector MvL0 is a motion vector which is used to code thecurrent block. A reference picture index RefL0 is a reference pictureindex which is indicated in the reference picture list L0 in coding ofthe current block.

A motion vector MvL0_N is a motion vector used to code a neighboringblock. A reference picture index RefL0_N is a reference picture indexindicated in the reference picture list L0 in coding of the neighboringblock.

For example, the addition unit 131 adds the motion vector MvL0_N to thelist. The selection unit 132 then selects the motion vector MvL0_N fromthe list. Subsequently, the coding unit 101 codes the current blockusing the selected motion vector MvL0_N.

Specifically, the coding unit 101 merges the motion vector MvL0_N of theneighboring block to the motion vector MvL0 of the current block, andcodes the current block using the merged motion vector MvL0_N. Thecoding unit 101 may merge the reference picture index RefL0_N of theneighboring block to the reference picture index RefL0 of the currentblock.

Furthermore, the coding unit 101 codes the index which represents theselected motion vector MvL0_N. By so doing, the coding efficiencyimproves.

FIG. 10 shows the motion vector of the co-located block according tothis embodiment. In FIG. 10, a plurality of pictures B0 to B4 are shownin display order, as in FIG. 9.

The motion vector MvL0 is, as in the case of FIG. 9, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 9, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL0_Col is a motion vector used to code the co-locatedblock. A reference picture index RefL0_Col is a reference picture indexindicated in the reference picture list L0 in coding of the co-locatedblock.

A motion vector sMvL0_Col is a motion vector scaled at the ratio betweenthe temporal distance from the current block to a reference picturethereof and the temporal distance from the co-located block to areference picture thereof. The motion vector sMvL0_Col and the motionvector MvL0_Col are parallel to each other. For example, sMvL0_Col isderived from Expression 1.

sMvL0_(—) Col=MvL0_(—) Col*(POC(RefL0)−curPOC)/(POC(RefL0_(—)Col)−colPOC)  (Expression 1)

Here, curPOC represents the display order of the current picture, colPOCrepresents the display order of the picture including the co-locatedblock, and POC(r) represents the display order of the reference pictureidentified by a reference picture index r. By so doing, the motionvector sMvL0_Col is obtained.

For example, the addition unit 131 obtains the motion vector sMvL0_Colby scaling the motion vector MvL0_Col. The addition unit 131 then addsthe motion vector sMvL0_Col to the list. Subsequently, the selectionunit 132 selects the motion vector sMvL0_Col from the list.

Subsequently, the coding unit 101 codes the current block using theselected motion vector sMvL0_Col.

Specifically, the coding unit 101 merges, to the motion vector MvL0 ofthe current block, the motion vector sMvL0_Col obtained by scaling themotion vector MvL0_Col of the co-located block. Subsequently, the codingunit 101 codes the current block using the merged motion vectorsMvL0_Col.

Furthermore, the coding unit 101 codes the index which represents theselected motion vector sMvL0_Col. By so doing, the coding efficiencyimproves.

FIG. 11 shows a first example of a scaling process according to thisembodiment. The image coding apparatus according to this embodiment may,as in the case of the temporal direct mode, scale the motion vector of aneighboring block and use the scaled motion vector as the merge vector.FIG. 11 shows a scaling process on the motion vector of the neighboringblock. In FIG. 11, a plurality of pictures B0 to B4 are shown in displayorder, as in FIG. 9.

The motion vector MvL0 is, as in the case of FIG. 9, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 9, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL0_N is, as in the case of FIG. 9, a motion vectorused to code the neighboring block. A reference picture index RefL0_Nis, as in the case of FIG. 9, a reference picture index indicated in thereference picture list L0 in coding of the neighboring block.

A motion vector sMvL0_N is a motion vector scaled at the ratio betweenthe temporal distance from the current block to a reference picturethereof and the temporal distance from the neighboring block to areference picture thereof. The motion vector sMvL0_N and the motionvector MvL0_N are parallel to each other. For example, sMvL0_N isderived from Expression 2.

sMvL0_(—) N=MvL0_(—) N*(POC(RefL0)−curPOC)/(POC(RefL0_(—)N)−curPOC)  (Expression 2)

Here, curPOC represents the display order of the current picture, andPOC(r) represents the display order of the reference picture identifiedby the reference picture index r. By so doing, the motion vector sMvL0_Nis obtained.

For example, the addition unit 131 obtains the motion vector sMvL0_N byscaling the motion vector MvL0_N. The addition unit 131 then adds themotion vector sMvL0_N to the list. Subsequently, the selection unit 132selects the motion vector sMvL0_N from the list.

Subsequently, the coding unit 101 codes the current block using theselected motion vector MvL0_N.

Specifically, the coding unit 101 merges, to the motion vector MvL0 ofthe current block, the motion vector sMvL0_N obtained by scaling themotion vector MvL0_N of the neighboring block. Subsequently, the codingunit 101 codes the current block using the merged motion vector sMvL0_N.

Furthermore, the coding unit 101 codes the index which represents theselected motion vector sMvL0_N. By so doing, the coding efficiencyimproves.

FIG. 12 shows a second example of the scaling process according to thisembodiment. FIGS. 9, 10, and 11 show the examples where the referencepicture list L0 is used. However, even when the reference picture listL1 is used, the image coding apparatus according to this embodiment canlikewise use the motion vector of the associated block as the mergevector.

Furthermore, the image coding apparatus according to this embodiment mayuse, as the merge vector in the inter prediction using the referencepicture list L0, a motion vector in the inter prediction using thereference picture list L1. For example, the image coding apparatus mayuse a motion vector in backward prediction as a merge vector in forwardprediction. FIG. 12 shows an example of such a case. In FIG. 12, aplurality of pictures B0 to B4 are shown in display order, as in FIG. 9.

The motion vector MvL0 is, as in the case of FIG. 9, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 9, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL1_N is a motion vector used to code a neighboringblock. A reference picture index RefL1_N is a reference picture indexindicated in the reference picture list L1 in coding of the neighboringblock.

A motion vector sMvL0_N is a motion vector scaled at the ratio betweenthe temporal distance from the current block to a reference picturethereof and the temporal distance from the neighboring block to areference picture thereof. The motion vector sMvL0_N and the motionvector MvL1_N are parallel to each other. For example, sMvL0_N isderived from Expression 3.

sMvL0_(—) N=MvL1_(—) N*(POC(RefL0)−curPOC)/(POC(RefL1_(—)N)−curPOC)  (Expression 3)

Here, curPOC represents the display order of the current picture, andPOC(r) represents the display order of the reference picture identifiedby the reference picture index r. By so doing, the motion vector sMvL0_Nis obtained.

Thus, even when the prediction direction is opposite, the image codingapparatus can scale the motion vector and use the scaled motion vectoras the merge vector.

FIG. 13 shows a first example of a reference relationship according tothis embodiment. FIG. 13 shows two views: a base view and a non-baseview. Each of the two views includes a plurality of pictures. Forexample, the two views are two videos captured from differentviewpoints. The image coding apparatus according to this embodiment mayhave a function of the multiview video coding (MVC) in which multiviewvideo is coded.

The image coding apparatus having the MVC function is capable of codinga picture in the non-base view with reference to a picture in the baseview. When the image coding apparatus codes the picture in the non-baseview with reference to the picture in the base view, the display orderof the picture to be referred to and the display order of the picture tobe coded match.

In FIG. 13, a plurality of pictures B00 to B04 in the base view and aplurality of pictures B10 to B14 in the non-base view are shown indisplay order.

A motion vector MvL0 is a motion vector which is used to code thecurrent block. A reference picture index RefL0 is a reference pictureindex which is indicated in the reference picture list L0 in coding ofthe current block.

A motion vector MvL0_N is a motion vector used to code a neighboringblock. A reference picture index RefL0_N is a reference picture indexindicated in the reference picture list L0 in coding of the neighboringblock.

In the example of FIG. 13, the temporal distance from the current blockto a reference picture thereof is different from the temporal distancefrom the neighboring block to a reference picture thereof. The motionvector MvL0_N therefore needs to be scaled according to Expression 2.However, in the example of FIG. 13, the temporal distance from theneighboring block to a reference picture thereof is 0. Accordingly, thedenominator in Expression 2 becomes 0, with the result that the additionunit 131 cannot scale the motion vector MvL0_N.

Thus, in such a case, the addition unit 131 does not add the motionvector of such neighboring block to the list. By so doing, the additionunit 131 does not have to calculate a merge vector from such neighboringblock. Furthermore, this results in that the motion vector of suchneighboring block is not selected by the selection unit 132. Thus, theimage coding apparatus according to this embodiment can continue itsoperation without problems.

FIG. 14 shows a second example of the reference relationship accordingto this embodiment. FIG. 14 shows the two views: the base view and thenon-base view, as in FIG. 13. Furthermore, the plurality of pictures B00to B04 in the base view and the plurality of pictures B10 to B14 in thenon-base view are shown in display order.

The motion vector MvL0 is, as in the case of FIG. 13, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 13, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL0_N is, as in the case of FIG. 13, a motion vectorused to code the neighboring block. A reference picture index RefL0_Nis, as in the case of FIG. 13, a reference picture index indicated inthe reference picture list L0 in coding of the neighboring block.

In the example of FIG. 14, the temporal distance from the current blockto a reference picture thereof is different from the temporal distancefrom the neighboring block to a reference picture thereof. The motionvector MvL0_N therefore needs to be scaled according to Expression 2.However, in the example of FIG. 14, the temporal distance from thecurrent block to a reference picture thereof is 0. Accordingly, thenumerator in Expression 2 becomes 0, with the result that the additionunit 131 cannot appropriately scale the motion vector MvL0_N.

Thus, in such a case, the addition unit 131 does not add the motionvector of such neighboring block to the list. By so doing, the additionunit 131 does not have to calculate a merge vector from such neighboringblock. Furthermore, this results in that the motion vector of suchneighboring block is not selected by the selection unit 132. Thus, theimage coding apparatus according to this embodiment can continue itsoperation without problems.

FIG. 15 shows a third example of the reference relationship according tothis embodiment. FIG. 15 shows the two views: the base view and thenon-base view, as in FIG. 13. Furthermore, the plurality of pictures B00to B04 in the base view and the plurality of pictures B10 to B14 in thenon-base view are shown in display order.

The motion vector MvL0 is, as in the case of FIG. 13, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 13, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL0_Col is a motion vector used to code the co-locatedblock. A reference picture index RefL0_Col is a reference picture indexindicated in the reference picture list L0 in coding of the neighboringblock.

In the example of FIG. 15, the temporal distance from the current blockto a reference picture thereof is different from the temporal distancefrom the co-located block to a reference picture thereof. Thus, themotion vector MvL0_Col therefore needs to be scaled according toExpression 1. However, in the example of FIG. 15, the temporal distancefrom the co-located block to a reference picture thereof is 0.Accordingly, the denominator in Expression 1 becomes 0, with the resultthat the addition unit 131 cannot scale the motion vector MvL0_Col.

Thus, in such a case, the addition unit 131 does not add the motionvector of such co-located block to the list. By so doing, the additionunit 131 does not have to calculate a merge vector from such co-locatedblock. Furthermore, this results in that the motion vector of suchco-located block is not selected by the selection unit 132. Thus, theimage coding apparatus according to this embodiment can continue itsoperation without problems.

FIG. 16 shows a fourth example of the reference relationship accordingto this embodiment. FIG. 16 shows the two views: the base view and thenon-base view, as in FIG. 15. Furthermore, the plurality of pictures B00to B04 in the base view and the plurality of pictures B10 to B14 in thenon-base view are shown in display order.

The motion vector MvL0 is, as in the case of FIG. 15, a motion vectorwhich is used to code the current block. The reference picture indexRefL0 is, as in the case of FIG. 15, a reference picture index which isindicated in the reference picture list L0 in coding of the currentblock.

A motion vector MvL0_Col is, as in the case of FIG. 15, a motion vectorused to code the co-located block. A reference picture index RefL0_Colis, as in the case of FIG. 15, a reference picture index indicated inthe reference picture list L0 in coding of the co-located block.

In the example of FIG. 16, the temporal distance from the current blockto a reference picture thereof is different from the temporal distancefrom the co-located block to a reference picture thereof. Thus, themotion vector MvL0_Col therefore needs to be scaled according toExpression 1. However, in the example of FIG. 16, the temporal distancefrom the current block to a reference picture thereof is 0. Accordingly,the numerator in Expression 1 becomes 0, with the result that theaddition unit 131 cannot appropriately scale the motion vector MvL0_Col.

Thus, in such a case, the addition unit 131 does not add the motionvector of such co-located block to the list. By so doing, the additionunit 131 does not have to calculate a merge vector from such co-locatedblock. Furthermore, this results in that the motion vector of suchco-located block is not selected by the selection unit 132. Thus, theimage coding apparatus according to this embodiment can continue itsoperation without problems.

It is to be noted that FIGS. 13 to 16 show the cases where the referencepicture list L0 is used. However, the same applies to the case where thereference picture list L1 is used. Furthermore, the same applies also tothe case where the motion vector in the inter prediction using thereference picture list L1 is used as the merge vector in the interprediction using the reference picture list L0. In addition, althoughthe plurality of views are shown in the examples of FIGS. 13 to 16, theimage coding apparatus may apply the same or like processing not only inthe case of MVC, but also in a single view.

FIG. 17 is a flowchart showing an operation of the image codingapparatus shown in FIG. 8. First, the addition unit 131 selectively addsa motion vector of each of one or more associated blocks to a list(S11). Each of the one or more associated blocks is a block which isincluded in the current picture and spatially adjacent to the currentblock, or a block which is included in a picture different from thecurrent picture and spatially matches or corresponds to the currentblock.

(i) For each of the one or more associated blocks, when the associatedblock has been coded by referring to, using the motion vector of theassociated block, a picture which temporally matches the associatedblock, the addition unit 131 does not add the motion vector of theassociated block to the list. (ii) For each of the one or moreassociated blocks, when the current block is coded using the motionvector of the current block with reference to a picture which temporallymatches the current block, the addition unit 131 does not add the motionvector of the associated block to the list. It may be possible that theaddition unit 131 apply only one of the two limitations (i) and (ii).

Next, from the list, the selection unit 132 selects, as the mergevector, a motion vector which is used to code the motion vector of thecurrent block (S12). The coding unit 101 then codes the current blockusing the merge vector (S13). Specifically, the coding unit 101 mergesthe merge vector to the current block and codes the current block usingthe merge vector. By so doing, the current block is coded.

FIG. 18 is a flowchart showing details of the operation shown in FIG.17. In FIG. 18, the addition process (S11) shown in FIG. 17 isspecifically shown.

First, the addition unit 131 determines whether or not the current blockand a reference block thereof match temporally (S21). Subsequently, whenthe current block and a reference block thereof match temporally (Yes inS21), the addition unit 131 adds a disparity vector to the list (S22).The disparity vector is a motion vector which represents a magnitude anda direction of disparity. For example, the disparity vector represents adifference in image location between a picture in the base view and apicture in the non-base view.

The addition unit 131 may add, to the list, the disparity vector whichhas been used in the past. Specifically, the addition unit 131 may add,to the list, the motion vector which was used in the past when the baseview was referred to. In addition, according to statistics such as theaverage of the disparity vectors which have been used in the past, theaddition unit 131 may calculate a disparity vector which is to be addedto the list.

On the other hand, when the current block and a reference block thereofdo not match temporally (No in S21), the addition unit 131 determines,for each of the one or more associated blocks, whether or not theassociated block and a reference picture thereof match temporally (S23).When the associated block and a reference picture thereof do not matchtemporally (No in S23), the addition unit 131 adds the motion vector ofthe associated block to the list (S24). At this time, the addition unit131 may scale the motion vector of the associated block and add thescaled motion vector to the list.

Next, the addition unit 131 deletes, from the list, a duplicatecandidate and an unavailable candidate (S25). By so doing, anappropriate list is created.

In addition, the coding unit 101 may attach a disparity vector to aheader. For example, to the header of an entire coded stream, the codingunit 101 may attach a disparity vector as a sequence parameter set(SPS).

Alternatively, to the header of a picture included in a coded stream,the coding unit 101 may attach a disparity vector as a picture parameterset (PPS). To the header of a slice included in a coded stream, thecoding unit 101 may attach a disparity vector as a slice header.

Furthermore, what the addition unit 131 adds to the list is not limitedto the disparity vector and may be a predetermined vector. To the headerof a coded stream, the coding unit 101 may then attach the predeterminedvector as a sequence parameter set, a picture parameter set, or a sliceheader. The magnitude of the predetermined vector which is added to thelist may be 0.

FIG. 19 is a flowchart showing a variation of the operation shown inFIG. 17. First, the addition unit 131 selectively adds a motion vectorof each of one or more associated blocks to a list (S31).

Here, when at least one motion vector is added to the list (Yes in S31),the selection unit 132 determines whether or not to select a mergevector from the list (S32). At this time, the selection unit 132 mayselect or not select a merge vector. For example, when the list containsno motion vector which is close to the motion vector of the currentblock, the selection unit 132 does not have to select a merge vectorfrom the list.

When a merge vector is selected (Yes in S32), the coding unit 101 codesthe current block using the selected merge vector (S33).

When no motion vector is added to the list (No in S31) or when no mergevector is selected (No in S32), the coding unit 101 codes the currentblock using the motion vector resulting from motion estimation or thelike (S34). By so doing, even when no motion vector is added to the list(No in S31) or when no merge vector is selected (No in S32), the imagecoding apparatus can continue its operation without problems.

It is to be noted that when no motion vector is added to the list (No inS31) or when no merge vector is selected (No in S32), the merge vectormay be deemed to be a predetermined motion vector.

As above, the image coding apparatus is capable of appropriatelyselecting a merge vector from the list even when there is a possibilitythat a block is coded with reference to a picture which temporallymatches the block. Although the foregoing describes the image codingapparatus, an image decoding apparatus can also appropriately select amerge vector from the list in the same or like procedure.

FIG. 20 is a structural diagram showing an image decoding apparatusaccording to this embodiment. The image decoding apparatus shown in FIG.20 includes the decoding unit 201 and the inter prediction control unit221. The decoding unit 201 includes a variable-length decoding unit 205,an inverse quantization unit 206, an inverse orthogonal transform unit207, an addition unit 208, a block memory 209, an intra prediction unit210, a frame memory 211, an inter prediction unit 212, and a switch 213.

The variable-length decoding unit 205 performs a variable-lengthdecoding process on a received bitstream to decode the picture typeinformation, the merge vector index, the prediction error data, and thelike. The inverse quantization unit 206 performs an inverse quantizationprocess on the prediction error data. The inverse orthogonal transformunit 207 transforms, from the frequency domain into the image domain,the prediction error data on which the inverse quantization process hasbeen performed. The addition unit 208 adds the prediction image data andthe prediction error data to generate decoded image data.

The block memory 209 is a memory for storing the decoded image data on aper block basis. The frame memory 211 is a memory for storing thedecoded image data on a per frame basis.

The intra prediction unit 210 performs intra prediction using theper-block decoded image data stored in the block memory 209, to generateprediction image data of a current block to be decoded. The interprediction unit 212 performs inter prediction using the per-framedecoded image data stored in the frame memory 211, to generateprediction image data of the current block. The switch 213 switches acoding mode to the intra prediction or the inter prediction.

The inter prediction control unit 221 selects a merge vector from thelist. Processing which is performed by the inter prediction control unit221 is the same or alike as the processing which is performed by theinter prediction control unit 121 in the image coding apparatus. Inother words, the inter prediction control unit 221 is achieved bychanging the coding part of the above-described coding processing intodecoding. It is to be noted that, in selecting a merge vector from thelist, the inter prediction control unit 221 uses an index decoded by thevariable-length decoding unit 205.

Although FIG. 20 shows an example of the configuration of the imagedecoding apparatus according to this embodiment, a specific structuralembodiment is not limited to the configuration shown in FIG. 20. Forexample, the decoding unit 201 does not need to include a plurality ofstructural elements. In addition, the decoding unit 201 may decode animage without performing the inverse frequency transform, the inversequantization, the intra prediction, and the like.

FIG. 21 shows a configuration of main structural elements of the imagedecoding apparatus shown in FIG. 20. The image decoding apparatus shownin FIG. 21 includes the decoding unit 201 and the inter predictioncontrol unit 221. The inter prediction control unit 221 includes anaddition unit 231 and a selection unit 232.

The addition unit 231 selectively adds a motion vector of each of one ormore associated blocks to a list. Specifically, the adding unit 231selects, for each of the one or more associated blocks, whether or notto add the motion vector of the associated block to the list, and adds,to the list, the motion vector selected as a motion vector to be added.The addition unit 231 may add all the one or more motion vectors of theone or more associated blocks to the list and may alternatively add partof the one or more motion vectors of the one or more associated blocksto the list.

The associated block is a decoded neighboring block, a decodedco-located block, or the like. Specifically, the associated bock may bea block which is included in the current picture and spatially adjacentto the current block. Alternatively, the associated block may be a blockwhich is included in one or more pictures different from the currentpicture and spatially matches or corresponds to the current block.

The selection unit 232 selects a merge vector from the list.Specifically, the selection unit 232 selects, as the merge vector, amotion vector which is used to decode the current block. The motionvector of the current block is referred to also as a current motionvector.

The decoding unit 201 decodes the current block using the merge vectorselected by the selection unit 232. Specifically, the decoding unit 201merges, to the current block, the motion vector selected by theselecting unit 232, and decodes the current block using the mergedmotion vector.

By so doing, the image decoding apparatus can select the merge vectorfrom the list and use the merge vector to decode the current block.Although the addition unit 231 and the selection unit 232 are includedin the inter prediction control unit 221 in FIG. 21, the addition unit231 and the selection unit 232 may be independent of the interprediction control unit 221. In this case, the inter prediction controlunit 221 does not have to be included in the image decoding apparatus.

FIG. 22 is a flowchart showing an operation of the image decodingapparatus shown in FIG. 21. First, the addition unit 231 selectivelyadds a motion vector of each of one or more associated blocks to a list(S41). Each of the one or more associated blocks is a block which isincluded in the current picture and spatially adjacent to the currentblock, or a block which is included in a picture different from thecurrent picture and spatially matches or corresponds to the currentblock.

(i) For each of the one or more associated blocks, when the associatedblock has been decoded by referring to, using the motion vector of theassociated block, a picture which temporally matches the associatedblock, the addition unit 231 does not add the motion vector of theassociated block to the list. (ii) For each of the one or moreassociated blocks, when the current block is decoded using the motionvector of the current block with reference to a picture which temporallymatches the current block, the addition unit 231 does not add the motionvector of the associated block to the list. It may be possible that theaddition unit 231 apply only one of the two limitations (i) and (ii).

Next, from the list, the selection unit 232 selects, as the mergevector, a motion vector which is used to decode the current block (S42).

Next, the decoding unit 201 decodes the current block using the mergevector selected by the selection unit 232 (S43). Specifically, thedecoding unit 201 merges the merge vector to the current block anddecodes the current block using the merge vector. By so doing, thecurrent block is decoded.

FIG. 23 is a flowchart showing details of the operation shown in FIG.22. In FIG. 23, the addition process (S41) shown in FIG. 22 isspecifically shown.

First, the addition unit 231 determines whether or not the current blockand a reference block thereof match temporally (S51). Subsequently, whenthe current block and a reference block thereof match temporally (Yes inS51), the addition unit 231 adds a disparity vector to the list (S52).

The addition unit 231 may add, to the list, the disparity vector whichhas been used in the past. Specifically, the addition unit 231 may add,to the list, the motion vector which was used in the past when the baseview was referred to. In addition, according to statistics such as theaverage of the disparity vectors which have been used in the past, theaddition unit 231 may calculate a disparity vector which is to be addedto the list.

On the other hand, when the current block and a reference block thereofdo not match temporally (No in S51), the addition unit 231 determines,for each of the one or more associated blocks, whether or not theassociated block and a reference picture thereof match temporally (S53).When the associated block and a reference picture thereof do not matchtemporally (No in S53), the addition unit 231 adds the motion vector ofthe associated block to the list (S54). At this time, the addition unit231 may scale the motion vector of the associated block and add thescaled motion vector to the list.

Next, the addition unit 231 deletes, from the list, a duplicatecandidate and an unavailable candidate (S55). By so doing, anappropriate list is created.

In addition, the decoding unit 201 may obtain a disparity vector whichhas been attached to a header included in the coded stream. For example,the decoding unit 201 may obtain a disparity vector from the sequenceparameter set that is the header of the entire coded stream.Alternatively, the decoding unit 201 may obtain a disparity vector fromthe picture parameter set that is the header of a picture included inthe coded stream. The decoding unit 201 may obtain a disparity vectorfrom the slice header that is the header of a slice included in thecoded stream.

Furthermore, what the addition unit 231 adds to the list is not limitedto the disparity vector and may be a predetermined vector. From theheader (such as the sequence parameter set, the picture parameter set,or the slice header) of the coded stream, the decoding unit 201 may thenobtain the predetermined vector.

FIG. 24 is a flowchart showing a variation of the operation shown inFIG. 22. First, the addition unit 231 selectively adds a motion vectorof each of one or more associated blocks to a list (S61).

Here, when at least one motion vector is added to the list (Yes in S61),the selection unit 232 determines whether or not to select a mergevector from the list (S62). For example, when the index representing themerge vector has not been coded, that is, when the coded stream containsno index, the selection unit 232 does not select merge vectors from thelist.

When a merge vector is selected (Yes in S62), the decoding unit 201decodes the current block using the merge vector selected by theselection unit 232 (S63).

When no motion vector is added to the list (No in S61) or when no mergevector is selected (No in S62), the decoding unit 201 decodes the motionvector of the current block. Subsequently, the decoding unit 201 decodesthe current block using the decoded motion vector (S64). By so doing,even when no motion vector is added to the list (No in S61) or when nomerge vector is selected (No in S62), the image decoding apparatus cancontinue its operation without problems.

It is to be noted that when no motion vector is added to the list (No inS61) or when no merge vector is selected (No in S62), the merge vectormay be deemed to be a predetermined motion vector.

As above, the image decoding apparatus is capable of appropriatelyselecting a merge vector from the list even when a block is decoded withreference to a picture which temporally matches the block.

In the above description, the motion vector of each of the associatedblocks is added to the list. However, the mean, the median, and the likeof the motion vectors of the associated blocks may be added to the list.In this case, the addition unit 131 of the image coding apparatus andthe addition unit 231 of the image decoding apparatus calculate themean, the median, and the like, and add them to the list. Alternatively,the two addition units 131 and 231 may calculate the mean, the median,and the like of the motion vectors from the plurality of associatedblocks excluding the associated blocks which temporally match referencepictures thereof.

Furthermore, in the above description, when the block to be processed(the current block to be coded or decoded) and the reference picture ofthe block to be processed match temporally, adding the motion vector ofthe associated block to the list is limited. Alternatively, when theassociated block and the reference picture of the associated block matchtemporally, adding the motion vector of the associated block to the listis limited.

However, when the block to be processed and the reference picture of theblock to be processed match temporally and when the associated block andthe reference picture of the associated block match temporally, there isno need to scale the motion vector of the associated block. Accordingly,in such a case, the addition unit 131 of the image coding apparatus andthe addition unit 231 of the image decoding apparatus may add the motionvector of the associated block to the list without performing anyprocessing on the motion vector. The following shall specificallydescribe an example of such a case.

FIG. 25 shows a fifth example of the reference relationship according tothis embodiment. FIG. 25 shows the two views: the base view and thenon-base view, as in FIGS. 13 to 16. Furthermore, the plurality ofpictures B00 to B04 in the base view and the plurality of pictures B10to B14 in the non-base view are shown in display order.

In the example of FIG. 25, the reference picture index RefL0 of theblock to be processed and the reference picture index RefL0_N of theneighboring block match. In this case, the temporal distance from theblock to be processed to a reference picture thereof and the temporaldistance from the neighboring block to a reference picture thereofmatch. Thus, there is no need to scale the motion vector MvL0_N of theneighboring block. Accordingly, in this case, the addition unit 131 ofthe image coding apparatus and the addition unit 231 of the imagedecoding apparatus may add the motion vector MvL0_N to the list withoutperforming any processing on the motion vector MvL0_N.

FIG. 26 shows a sixth example of the reference relationship according tothis embodiment. FIG. 26 shows the two views: the base view and thenon-base view, as in FIGS. 13 to 16. Furthermore, the plurality ofpictures B00 to B04 in the base view and the plurality of pictures B10to B14 in the non-base view are shown in display order.

In the example of FIG. 26, the temporal distance from the block to beprocessed to a reference picture thereof and the temporal distance fromthe co-located block to a reference picture thereof match. Thus, thereis no need to scale the motion vector MvL0_Col of the co-located block.Accordingly, in this case, the addition unit 131 of the image codingapparatus and the addition unit 231 of the image decoding apparatus mayadd the motion vector MvL0_Col to the list without performing anyprocessing on the motion vector MvL0_Col.

In the examples of FIGS. 25 and 26, the block to be processed and thereference picture of the block to be processed match temporally, and theassociated block and the reference picture of the associated block matchtemporally. As described above, in such a case, the addition unit 131 ofthe image coding apparatus and the addition unit 231 of the imagedecoding apparatus may add the motion vector of the associated block tothe list without performing any processing on the motion vector.

Furthermore, as above, the image coding apparatus according to thisembodiment is an image coding apparatus which codes a plurality ofblocks included in a plurality of pictures of an image and includes theaddition unit 131, the selection unit 132, and the coding unit 101.These operations described above shall be described below for thepurpose of confirmation.

The addition unit 131 determines, for each of one or more associatedblocks that are one or more blocks included in a plurality of blocks,whether or not to add the motion vector of the associated block to thelist. When it is determined that the motion vector of the associatedblock is to be added to the list, then the addition unit 131 adds themotion vector of the associated block to the list.

The selection unit 132 selects, from the list, a motion vector to bemerged to a current block that is a block which is included in theplurality of blocks and is different from the one or more associatedblocks.

The coding unit 101 merges, to the current block, the motion vectorselected by the selection unit 132, and codes the current block usingthe merged motion vector as the motion vector of the current block.

Specifically, when an associated picture and an associated referencepicture match temporally or when a current picture and a currentreference picture match temporally, the addition unit 131 determines notto add the motion vector of the associated block to the list.

Here, the associated picture is a picture which includes the associatedblock. The associated reference picture is a picture which has beenreferred to using the motion vector of the associated block in coding ofthe associated block. The current picture is a picture which includesthe current block. The current reference picture is a picture which isreferred to using the motion vector of the current block in coding ofthe current block.

For example, when a view including the associated picture is differentfrom a view including the associated reference picture or when a viewincluding the current picture is different from a view including thecurrent reference picture, the addition unit 131 may determine not toadd the motion vector of the associated block to the list. Furthermore,for example, when the display order of the associated picture and thedisplay order of the associated reference picture match or when thedisplay order of the current picture and the display order of thecurrent reference picture match, the addition unit 131 may determine notto add the motion vector of the associated block to the list.

Furthermore, for example, except when the associated picture and theassociated reference picture match temporally and the current pictureand the current associated picture match temporally, the addition unit131 may determine not to add the motion vector of the associated blockto the list. Furthermore, for example, the addition unit 131 maydetermine not to add the motion vector of the associated block to thelist when only one of the following is true: a view including theassociated picture is different from a view including the associatedreference picture; and a view including the current picture is differentfrom a view including the current reference picture.

Furthermore, for example, the addition unit 131 may add a predeterminedmotion vector to the list when the current picture and the currentreference picture match temporally. Furthermore, for example, theaddition unit 131 may add, to the list, a predetermined motion vectorwhich is attached to a header of a coded stream. Furthermore, forexample, the addition unit 131 may add, to the list, a disparity vectorindicating a direction and a magnitude of disparity as the predeterminedmotion vector.

Furthermore, for example, the coding unit 101 may code the current blockusing a motion vector resulting from motion estimation and code themotion vector resulting from the motion estimation when no motion vectoris added to the list.

Furthermore, for example, the addition unit 131 may scale the motionvector of the associated block using a ratio of the temporal distancebetween the current picture and the current reference picture to thetemporal distance between the associated picture and the associatedreference picture. Subsequently, the addition unit 131 may add thescaled motion vector to the list.

Furthermore, as above, the image decoding apparatus according to thisembodiment is an image decoding apparatus which decodes a plurality ofblocks included in a plurality of pictures of an image and includes theaddition unit 231, the selection unit 232, and the decoding unit 201.These operations described above shall be described below for thepurpose of confirmation.

The addition unit 231 determines, for each of one or more associatedblocks that are one or more blocks included in a plurality of blocks,whether or not to add the motion vector of the associated block to thelist. When it is determined that the motion vector of the associatedblock is to be added to the list, then the addition unit 231 adds themotion vector of the associated block to the list.

The selection unit 232 selects, from the list, a motion vector to bemerged to a current block that is a block which is included in theplurality of blocks and is different from the one or more associatedblocks. The decoding unit 201 merges, to the current block, the motionvector selected by the selection unit 232, and decodes the current blockusing the merged motion vector as the motion vector of the currentblock.

Specifically, when an associated picture and an associated referencepicture match temporally or when a current picture and a currentreference picture match temporally, the addition unit 231 determines notto add the motion vector of the associated block to the list.

Here, the associated picture is a picture which includes the associatedblock. The associated reference picture is a picture which has beenreferred to using the motion vector of the associated block in decodingof the associated block. The current picture is a picture which includesthe current block. The current reference picture is a picture which isreferred to using the motion vector of the current block in decoding ofthe current block.

For example, when a view including the associated picture is differentfrom a view including the associated reference picture or when a viewincluding the current picture is different from a view including thecurrent reference picture, the addition unit 231 may determine not toadd the motion vector of the associated block to the list. Furthermore,for example, when the display order of the associated picture and thedisplay order of the associated reference picture match or when thedisplay order of the current picture and the display order of thecurrent reference picture match, the addition unit 231 may determine notto add the motion vector of the associated block to the list.

Furthermore, for example, except when the associated picture and theassociated reference picture match temporally and the current pictureand the current associated picture match temporally, the addition unit231 may determine not to add the motion vector of the associated blockto the list. Furthermore, for example, the addition unit 231 maydetermine not to add the motion vector of the associated block to thelist when only one of the following is true: a view including theassociated picture is different from a view including the associatedreference picture; and a view including the current picture is differentfrom a view including the current reference picture.

Furthermore, for example, the addition unit 231 may add a predeterminedmotion vector to the list when the current picture and the currentreference picture match temporally. Furthermore, for example, theaddition unit 231 may add, to the list, a predetermined motion vectorwhich has been attached to a header of a coded stream. Furthermore, forexample, the addition unit 231 may add, to the list, a disparity vectorindicating a direction and a magnitude of disparity as the predeterminedmotion vector.

Furthermore, for example, the decoding unit 201 may decode the motionvector of the current block and decode the current block using thedecoded motion vector when no motion vector is added to the list.

Furthermore, for example, the addition unit 231 may scale the motionvector of the associated block using a ratio of the temporal distancebetween the current picture and the current reference picture to thetemporal distance between the associated picture and the associatedreference picture. Subsequently, the addition unit 231 may add thescaled motion vector to the list.

Furthermore, the above-described image coding apparatus and theabove-described decoding apparatus may be combined. For example, animage coding and decoding apparatus may include the above-describedimage coding apparatus and the above-described image decoding apparatus.

Furthermore, in the above-described embodiment, each structural elementmay be constituted by dedicated hardware or achieved by executing asoftware program suited to the structural element. Each structuralelement may be achieved by a program execution unit such as a CPU or aprocessor executing a software program recorded on a recording mediumsuch as a hard disk or a semiconductor memory. Here, the software whichachieves the image coding apparatus or the image decoding apparatusaccording to the above-described embodiment is the following program.

Specifically, this program causes a computer to execute an image codingmethod of coding a plurality of blocks included in a plurality ofpictures of an image, the image coding method comprising: (i)determining, for each of one or more associated blocks, whether or notto add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) coding the currentblock using the merged motion vector as a motion vector of the currentblock, wherein, in the determining, it is determined that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block in codingof the associated block, the current picture being a picture includingthe current block, and the current reference picture being a picturewhich is referred to using the motion vector of the current block in thecoding of the current block.

Furthermore, this program causes a computer to execute an image decodingmethod of decoding a plurality of blocks included in a plurality ofpictures of an image, the image decoding method comprising: (i)determining, for each of one or more associated blocks, whether or notto add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) decoding thecurrent block using the merged motion vector as a motion vector of thecurrent block, wherein, in the determining, it is determined that themotion vector of the associated block is not to be added to the listwhen an associated picture and an associated reference picture matchtemporally or when a current picture and a current reference picturematch temporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block indecoding of the associated block, the current picture being a pictureincluding the current block, and the current reference picture being apicture which is referred to using the motion vector of the currentblock in the decoding of the current block.

Although the image coding apparatus and the image decoding apparatusaccording to one or more aspects of the inventive concepts have beendescribed above, the herein disclosed subject matter is to be considereddescriptive and illustrative only. Those skilled in the art will readilyappreciate that the appended Claims are of a scope intended to cover andencompass not only the particular embodiments disclosed, but alsoequivalent structures, methods, and/or uses which are obtained by makingvarious modifications in the embodiment and by arbitrarily combining thestructural elements in the embodiment, without materially departing fromthe principles and spirit of the inventive concept.

For example, processing which is executed by a particular processingunit may be executed by another processing unit. Furthermore, the orderto execute processes may be changed, and a plurality of processes may beexecuted in parallel.

Furthermore, the inventive concept can be implemented not only as theimage coding apparatus and the image decoding apparatus, but also as amethod which includes, as steps, the processing units included in eachof the image coding apparatus and the image decoding apparatus. Theinventive concept can be then implemented as a program for causing acomputer to execute the steps included in the method. Furthermore, theinventive concept can be implemented as a computer-readable recordingmedium such as a compact disc read-only memory (CD-ROM) on which theprogram has been recorded.

A plurality of structural elements included in the image codingapparatus and the image decoding apparatus may be implemented as a largescale integration (LSI) that is an integrated circuit. These structuralelements may be each provided on a single chip, and part or all of themmay be formed into a single chip. The name used here is LSI, but it mayalso be called an integrated circuit (IC), system LSI, super LSI, orultra LSI depending on the degree of integration.

Moreover, ways to achieve integration are not limited to the LSI, and aspecial circuit or a general purpose processor and so forth can alsoachieve the integration. Field Programmable Gate Array (FPGA) that canbe programmed, or a reconfigurable processor that allowsre-configuration of the connection or configuration of an LSI can beused for the same purpose.

In the future, with advancement in semiconductor technology, a brand-newtechnology may replace LSI. The structural elements included in theimage coding apparatus and the image decoding apparatus can beintegrated using such a technology.

Embodiment 2

The processing described in the above embodiment can be simplyimplemented in an independent computer system, by recording, in arecording medium, a program for implementing the configurations of themoving picture coding method (image coding method) and the movingpicture decoding method (image decoding method) described in the aboveembodiment. The recording media may be any recording media as long asthe program can be recorded, such as a magnetic disk, an optical disk, amagnetic optical disk, an IC card, and a semiconductor memory.

Hereinafter, the applications to the moving picture coding method (imagecoding method) and the moving picture decoding method (image decodingmethod) described in the above embodiment and systems using thereof willbe described. The system has a feature of having an image coding anddecoding apparatus that includes an image coding apparatus using theimage coding method and an image decoding apparatus using the imagedecoding method. Other configurations in the system can be changed asappropriate depending on the cases.

FIG. 27 illustrates an overall configuration of a content providingsystem ex100 for implementing content distribution services. The areafor providing communication services is divided into cells of desiredsize, and base stations ex106, ex107, ex108, ex109, and ex110 which arefixed wireless stations are placed in each of the cells. The contentproviding system ex100 is connected to devices, such as a computerex111, a personal digital assistant (PDA) ex112, a camera ex113, acellular phone ex114 and a game machine ex115, via the Internet ex101,an Internet service provider ex102, a telephone network ex104, as wellas the base stations ex106 to ex110, respectively.

However, the configuration of the content providing system ex100 is notlimited to the configuration shown in FIG. 27, and a combination inwhich any of the elements are connected is acceptable. In addition, eachdevice may be directly connected to the telephone network ex104, ratherthan via the base stations ex106 to ex110 which are the fixed wirelessstations. Furthermore, the devices may be interconnected to each othervia a short distance wireless communication and others.

The camera ex113, such as a digital video camera, is capable ofcapturing video. A camera ex116, such as a digital camera, is capable ofcapturing both still images and video. Furthermore, the cellular phoneex114 may be the one that meets any of the standards such as GlobalSystem for Mobile Communications (GSM) (registered trademark), CodeDivision Multiple Access (CDMA), Wideband-Code Division Multiple Access(W-CDMA), Long Term Evolution (LTE), and High Speed Packet Access(HSPA). Alternatively, the cellular phone ex114 may be a PersonalHandyphone System (PHS).

In the content providing system ex100, a streaming server ex103 isconnected to the camera ex113 and others via the telephone network ex104and the base station ex109, which enables distribution of images of alive show and others. In such a distribution, content (for example,video of a music live show) captured by the user using the camera ex113is coded as described above in the above embodiment (i.e., the camerafunctions as the image coding apparatus according to an embodimentdisclosed herein), and the coded content is transmitted to the streamingserver ex103. On the other hand, the streaming server ex103 carries outstream distribution of the transmitted content data to the clients upontheir requests. The clients include the computer ex111, the PDA ex112,the camera ex113, the cellular phone ex114, and the game machine ex115that are capable of decoding the above-mentioned coded data. Each of thedevices that have received the distributed data decodes and reproducesthe coded data (i.e., functions as the image decoding apparatusaccording to an embodiment disclosed herein).

The captured data may be coded by the camera ex113 or the streamingserver ex103 that transmits the data, or the coding processes may beshared between the camera ex113 and the streaming server ex103.Similarly, the distributed data may be decoded by the clients or thestreaming server ex103, or the decoding processes may be shared betweenthe clients and the streaming server ex103. Furthermore, the data of thestill images and video captured by not only the camera ex113 but alsothe camera ex116 may be transmitted to the streaming server ex103through the computer ex111. The coding processes may be performed by thecamera ex116, the computer ex111, or the streaming server ex103, orshared among them.

Furthermore, the coding and decoding processes may be performed by anLSI ex500 generally included in each of the computer ex111 and thedevices. The LSI ex500 may be configured of a single chip or a pluralityof chips. Software for coding and decoding video may be integrated intosome type of a recording medium (such as a CD-ROM, a flexible disk, anda hard disk) that is readable by the computer ex111 and others, and thecoding and decoding processes may be performed using the software.Furthermore, when the cellular phone ex114 is equipped with a camera,the video data obtained by the camera may be transmitted. The video datais data coded by the LSI ex500 included in the cellular phone ex114.

Furthermore, the streaming server ex103 may be composed of servers andcomputers, and may decentralize data and process the decentralized data,record, or distribute data.

As described above, the clients may receive and reproduce the coded datain the content providing system ex100. In other words, the clients canreceive and decode information transmitted by the user, and reproducethe decoded data in real time in the content providing system ex100, sothat the user who does not have any particular right and equipment canimplement personal broadcasting.

Aside from the example of the content providing system ex100, at leastone of the moving picture coding apparatus (image coding apparatus) andthe moving picture decoding apparatus (image decoding apparatus)described in the above embodiment may be implemented in a digitalbroadcasting system ex200 illustrated in FIG. 28. More specifically, abroadcast station ex201 communicates or transmits, via radio waves to abroadcast satellite ex202, multiplexed data obtained by multiplexingaudio data and others onto video data. The video data is data coded bythe moving picture coding method described in the above embodiment(i.e., data coded by the image coding apparatus according to anembodiment disclosed herein). Upon receipt of the multiplexed data, thebroadcast satellite ex202 transmits radio waves for broadcasting. Then,a home-use antenna ex204 with a satellite broadcast reception functionreceives the radio waves. Next, a device such as a television (receiver)ex300 and a set top box (STB) ex217 decodes the received multiplexeddata, and reproduces the decoded data (i.e., functions as the imagedecoding apparatus according to an embodiment disclosed herein).

Furthermore, a reader/recorder ex218 (i) reads and decodes themultiplexed data recorded on a recording medium ex215, such as a DVD anda BD, or (ii) codes video signals in the recording medium ex215, and insome cases, writes data obtained by multiplexing an audio signal on thecoded data. The reader/recorder ex218 can include the moving picturedecoding apparatus or the moving picture coding apparatus as shown inthe above embodiment. In this case, the reproduced video signals aredisplayed on the monitor ex219, and can be reproduced by another deviceor system using the recording medium ex215 on which the multiplexed datais recorded. It is also possible to implement the moving picturedecoding apparatus in the set top box ex217 connected to the cable ex203for a cable television or to the antenna ex204 for satellite and/orterrestrial broadcasting, so as to display the video signals on themonitor ex219 of the television ex300. The moving picture decodingapparatus may be implemented not in the set top box but in thetelevision ex300.

FIG. 29 illustrates the television (receiver) ex300 that uses the movingpicture coding method and the moving picture decoding method describedin the above embodiment. The television ex300 includes: a tuner ex301that obtains or provides multiplexed data obtained by multiplexing audiodata onto video data, through the antenna ex204 or the cable ex203, etc.that receives a broadcast; a modulation/demodulation unit ex302 thatdemodulates the received multiplexed data or modulates data intomultiplexed data to be supplied outside; and amultiplexing/demultiplexing unit ex303 that demultiplexes the modulatedmultiplexed data into video data and audio data, or multiplexes videodata and audio data coded by a signal processing unit ex306 into data.

The television ex300 further includes: a signal processing unit ex306including an audio signal processing unit ex304 and a video signalprocessing unit ex305 that decode audio data and video data and codeaudio data and video data, respectively (which function as the imagecoding apparatus and the image decoding apparatus according to anembodiment disclosed herein); and an output unit ex309 including aspeaker ex307 that provides the decoded audio signal, and a display unitex308 that displays the decoded video signal, such as a display.Furthermore, the television ex300 includes an interface unit ex317including an operation input unit ex312 that receives an input of a useroperation. Furthermore, the television ex300 includes a control unitex310 that controls overall each constituent element of the televisionex300, and a power supply circuit unit ex311 that supplies power to eachof the elements. Other than the operation input unit ex312, theinterface unit ex317 may include: a bridge ex313 that is connected to anexternal device, such as the reader/recorder ex218; a slot unit ex314for enabling attachment of the recording medium ex216, such as an SDcard; a driver ex315 to be connected to an external recording medium,such as a hard disk; and a modem ex316 to be connected to a telephonenetwork. Here, the recording medium ex216 can electrically recordinformation using a non-volatile/volatile semiconductor memory elementfor storage. The constituent elements of the television ex300 areconnected to each other through a synchronous bus.

First, the configuration in which the television ex300 decodesmultiplexed data obtained from outside through the antenna ex204 andothers and reproduces the decoded data will be described. In thetelevision ex300, upon a user operation through a remote controllerex220 and others, the multiplexing/demultiplexing unit ex303demultiplexes the multiplexed data demodulated by themodulation/demodulation unit ex302, under control of the control unitex310 including a CPU. Furthermore, the audio signal processing unitex304 decodes the demultiplexed audio data, and the video signalprocessing unit ex305 decodes the demultiplexed video data, using thedecoding method described in the above embodiment, in the televisionex300. The output unit ex309 provides the decoded video signal and audiosignal outside, respectively. When the output unit ex309 provides thevideo signal and the audio signal, the signals may be temporarily storedin buffers ex318 and ex319, and others so that the signals arereproduced in synchronization with each other. Furthermore, thetelevision ex300 may read multiplexed data not through a broadcast andothers but from the recording media ex215 and ex216, such as a magneticdisk, an optical disk, and a SD card. Next, a configuration in which thetelevision ex300 codes an audio signal and a video signal, and transmitsthe data outside or writes the data on a recording medium will bedescribed. In the television ex300, upon a user operation through theremote controller ex220 and others, the audio signal processing unitex304 codes an audio signal, and the video signal processing unit ex305codes a video signal, under control of the control unit ex310 using thecoding method described in the above embodiment. Themultiplexing/demultiplexing unit ex303 multiplexes the coded videosignal and audio signal, and provides the resulting signal outside. Whenthe multiplexing/demultiplexing unit ex303 multiplexes the video signaland the audio signal, the signals may be temporarily stored in thebuffers ex320 and ex321, and others so that the signals are reproducedin synchronization with each other. Here, the buffers ex318, ex319,ex320, and ex321 may be plural as illustrated, or at least one buffermay be shared in the television ex300. Furthermore, data may be storedin a buffer so that the system overflow and underflow may be avoidedbetween the modulation/demodulation unit ex302 and themultiplexing/demultiplexing unit ex303, for example.

Furthermore, the television ex300 may include a configuration forreceiving an AV input from a microphone or a camera other than theconfiguration for obtaining audio and video data from a broadcast or arecording medium, and may code the obtained data. Although thetelevision ex300 can code, multiplex, and provide outside data in thedescription, it may be capable of only receiving, decoding, andproviding outside data but not the coding, multiplexing, and providingoutside data.

Furthermore, when the reader/recorder ex218 reads or writes multiplexeddata from or on a recording medium, one of the television ex300 and thereader/recorder ex218 may decode or code the multiplexed data, and thetelevision ex300 and the reader/recorder ex218 may share the decoding orcoding.

As an example, FIG. 30 illustrates a configuration of an informationreproducing/recording unit ex400 when data is read or written from or onan optical disk. The information reproducing/recording unit ex400includes constituent elements ex401, ex402, ex403, ex404, ex405, ex406,and ex407 to be described hereinafter. The optical head ex401 irradiatesa laser spot in a recording surface of the recording medium ex215 thatis an optical disk to write information, and detects reflected lightfrom the recording surface of the recording medium ex215 to read theinformation. The modulation recording unit ex402 electrically drives asemiconductor laser included in the optical head ex401, and modulatesthe laser light according to recorded data. The reproductiondemodulating unit ex403 amplifies a reproduction signal obtained byelectrically detecting the reflected light from the recording surfaceusing a photo detector included in the optical head ex401, anddemodulates the reproduction signal by separating a signal componentrecorded on the recording medium ex215 to reproduce the necessaryinformation. The buffer ex404 temporarily holds the information to berecorded on the recording medium ex215 and the information reproducedfrom the recording medium ex215. The disk motor ex405 rotates therecording medium ex215. The servo control unit ex406 moves the opticalhead ex401 to a predetermined information track while controlling therotation drive of the disk motor ex405 so as to follow the laser spot.The system control unit ex407 controls overall the informationreproducing/recording unit ex400. The reading and writing processes canbe implemented by the system control unit ex407 using variousinformation stored in the buffer ex404 and generating and adding newinformation as necessary, and by the modulation recording unit ex402,the reproduction demodulating unit ex403, and the servo control unitex406 that record and reproduce information through the optical headex401 while being operated in a coordinated manner. The system controlunit ex407 includes, for example, a microprocessor, and executesprocessing by causing a computer to execute a program for read andwrite.

Although the optical head ex401 irradiates a laser spot in thedescription, it may perform high-density recording using near fieldlight.

FIG. 31 illustrates the recording medium ex215 that is the optical disk.On the recording surface of the recording medium ex215, guide groovesare spirally formed, and an information track ex230 records, in advance,address information indicating an absolute position on the diskaccording to change in a shape of the guide grooves. The addressinformation includes information for determining positions of recordingblocks ex231 that are a unit for recording data. Reproducing theinformation track ex230 and reading the address information in anapparatus that records and reproduces data can lead to determination ofthe positions of the recording blocks. Furthermore, the recording mediumex215 includes a data recording area ex233, an inner circumference areaex232, and an outer circumference area ex234. The data recording areaex233 is an area for use in recording the user data. The innercircumference area ex232 and the outer circumference area ex234 that areinside and outside of the data recording area ex233, respectively arefor specific use except for recording the user data. The informationreproducing/recording unit 400 reads and writes coded audio, coded videodata, or multiplexed data obtained by multiplexing the coded audio andvideo data, from and on the data recording area ex233 of the recordingmedium ex215.

Although an optical disk having a layer, such as a DVD and a BD isdescribed as an example in the description, the optical disk is notlimited to such, and may be an optical disk having a multilayerstructure and capable of being recorded on a part other than thesurface. Furthermore, the optical disk may have a structure formultidimensional recording/reproduction, such as recording ofinformation using light of colors with different wavelengths in the sameportion of the optical disk and for recording information havingdifferent layers from various angles.

Furthermore, a car ex210 having an antenna ex205 can receive data fromthe satellite ex202 and others, and reproduce video on a display devicesuch as a car navigation system ex211 set in the car ex210, in thedigital broadcasting system ex200. Here, a configuration of the carnavigation system ex211 will be a configuration, for example, includinga GPS receiving unit from the configuration illustrated in FIG. 29. Thesame will be true for the configuration of the computer ex111, thecellular phone ex114, and others.

FIG. 32A illustrates the cellular phone ex114 that uses the movingpicture coding method and the moving picture decoding method describedin the above embodiment. The cellular phone ex114 includes: an antennaex350 for transmitting and receiving radio waves through the basestation ex110; a camera unit ex365 capable of capturing moving and stillimages; and a display unit ex358 such as a liquid crystal display fordisplaying the data such as decoded video captured by the camera unitex365 or received by the antenna ex350. The cellular phone ex114 furtherincludes: a main body unit including an operation key unit ex366; anaudio output unit ex357 such as a speaker for output of audio; an audioinput unit ex356 such as a microphone for input of audio; a memory unitex367 for storing captured video or still pictures, recorded audio,coded or decoded data of the received video, the still pictures,e-mails, or others; and a slot unit ex364 that is an interface unit fora recording medium that stores data in the same manner as the memoryunit ex367.

Next, an example of a configuration of the cellular phone ex114 will bedescribed with reference to FIG. 32B. In the cellular phone ex114, amain control unit ex360 designed to control overall each unit of themain body including the display unit ex358 as well as the operation keyunit ex366 is connected mutually, via a synchronous bus ex370, to apower supply circuit unit ex361, an operation input control unit ex362,a video signal processing unit ex355, a camera interface unit ex363, aliquid crystal display (LCD) control unit ex359, amodulation/demodulation unit ex352, a multiplexing/demultiplexing unitex353, an audio signal processing unit ex354, the slot unit ex364, andthe memory unit ex367.

When a call-end key or a power key is turned ON by a user's operation,the power supply circuit unit ex361 supplies the respective units withpower from a battery pack so as to activate the cell phone ex114.

In the cellular phone ex114, the audio signal processing unit ex354converts the audio signals collected by the audio input unit ex356 invoice conversation mode into digital audio signals under the control ofthe main control unit ex360 including a CPU, ROM, and RAM. Then, themodulation/demodulation unit ex352 performs spread spectrum processingon the digital audio signals, and the transmitting and receiving unitex351 performs digital-to-analog conversion and frequency conversion onthe data, so as to transmit the resulting data via the antenna ex350.Also, in the cellular phone ex114, the transmitting and receiving unitex351 amplifies the data received by the antenna ex350 in voiceconversation mode and performs frequency conversion and theanalog-to-digital conversion on the data. Then, themodulation/demodulation unit ex352 performs inverse spread spectrumprocessing on the data, and the audio signal processing unit ex354converts it into analog audio signals, so as to output them via theaudio output unit ex357.

Furthermore, when an e-mail in data communication mode is transmitted,text data of the e-mail inputted by operating the operation key unitex366 and others of the main body is sent out to the main control unitex360 via the operation input control unit ex362. The main control unitex360 causes the modulation/demodulation unit ex352 to perform spreadspectrum processing on the text data, and the transmitting and receivingunit ex351 performs the digital-to-analog conversion and the frequencyconversion on the resulting data to transmit the data to the basestation ex110 via the antenna ex350. When an e-mail is received,processing that is approximately inverse to the processing fortransmitting an e-mail is performed on the received data, and theresulting data is provided to the display unit ex358.

When video, still images, or video and audio in data communication modeis or are transmitted, the video signal processing unit ex355 compressesand codes video signals supplied from the camera unit ex365 using themoving picture coding method shown in the above embodiment (i.e.,functions as the image coding apparatus according to an embodimentdisclosed herein), and transmits the coded video data to themultiplexing/demultiplexing unit ex353. In contrast, during when thecamera unit ex365 captures video, still images, and others, the audiosignal processing unit ex354 codes audio signals collected by the audioinput unit ex356, and transmits the coded audio data to themultiplexing/demultiplexing unit ex353.

The multiplexing/demultiplexing unit ex353 multiplexes the coded videodata supplied from the video signal processing unit ex355 and the codedaudio data supplied from the audio signal processing unit ex354, using apredetermined method. Then, the modulation/demodulation unit(modulation/demodulation circuit unit) ex352 performs spread spectrumprocessing on the multiplexed data, and the transmitting and receivingunit ex351 performs digital-to-analog conversion and frequencyconversion on the data so as to transmit the resulting data via theantenna ex350.

When receiving data of a video file which is linked to a Web page andothers in data communication mode or when receiving an e-mail with videoand/or audio attached, in order to decode the multiplexed data receivedvia the antenna ex350, the multiplexing/demultiplexing unit ex353demultiplexes the multiplexed data into a video data bit stream and anaudio data bit stream, and supplies the video signal processing unitex355 with the coded video data and the audio signal processing unitex354 with the coded audio data, through the synchronous bus ex370. Thevideo signal processing unit ex355 decodes the video signal using amoving picture decoding method corresponding to the moving picturecoding method shown in the above embodiment (i.e., functions as theimage decoding apparatus according to an embodiment disclosed herein),and then the display unit ex358 displays, for instance, the video andstill images included in the video file linked to the Web page via theLCD control unit ex359. Furthermore, the audio signal processing unitex354 decodes the audio signal, and the audio output unit ex357 providesthe audio.

Furthermore, similarly to the television ex300, a terminal such as thecellular phone ex114 probably has 3 types of implementationconfigurations including not only (i) a transmitting and receivingterminal including both a coding apparatus and a decoding apparatus, butalso (ii) a transmitting terminal including only a coding apparatus and(iii) a receiving terminal including only a decoding apparatus. Althoughthe digital broadcasting system ex200 receives and transmits themultiplexed data obtained by multiplexing audio data onto video data inthe description, the multiplexed data may be data obtained bymultiplexing not audio data but character data related to video ontovideo data, and may be not multiplexed data but video data itself.

As such, the moving picture coding method and the moving picturedecoding method in the above embodiment can be used in any of thedevices and systems described. Thus, the advantages described in theabove embodiment can be obtained.

Furthermore, various modifications and revisions can be made in theabove embodiment in the present disclosure without departing therefrom.

Embodiment 3

Video data can be generated by switching, as necessary, between (i) themoving picture coding method or the moving picture coding apparatusshown in the above embodiment and (ii) a moving picture coding method ora moving picture coding apparatus in conformity with a differentstandard, such as MPEG-2, MPEG-4 AVC, and VC-1.

Here, when a plurality of video data that conforms to the differentstandards is generated and is then decoded, the decoding methods need tobe selected to conform to the different standards. However, since towhich standard each of the plurality of the video data to be decodedconforms cannot be detected, there is a problem that an appropriatedecoding method cannot be selected.

In order to solve the problem, multiplexed data obtained by multiplexingaudio data and others onto video data has a structure includingidentification information indicating to which standard the video dataconforms. The specific structure of the multiplexed data including thevideo data generated in the moving picture coding method and by themoving picture coding apparatus shown in the above embodiment will behereinafter described. The multiplexed data is a digital stream in theMPEG-2 Transport Stream format.

FIG. 33 illustrates a structure of the multiplexed data. As illustratedin FIG. 33, the multiplexed data can be obtained by multiplexing atleast one of a video stream, an audio stream, a presentation graphicsstream (PG), and an interactive graphics stream.

The video stream represents primary video and secondary video of amovie, the audio stream (IG) represents a primary audio part and asecondary audio part to be mixed with the primary audio part, and thepresentation graphics stream represents subtitles of the movie. Here,the primary video is normal video to be displayed on a screen, and thesecondary video is video to be displayed on a smaller window in theprimary video. Furthermore, the interactive graphics stream representsan interactive screen to be generated by arranging the GUI components ona screen. The video stream is coded in the moving picture coding methodor by the moving picture coding apparatus shown in the above embodiment,or in a moving picture coding method or by a moving picture codingapparatus in conformity with a conventional standard, such as MPEG-2,MPEG-4 AVC, and VC-1. The audio stream is coded in accordance with astandard, such as Dolby-AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, andlinear PCM. Each stream included in the multiplexed data is identifiedby PID.

For example, 0x1011 is allocated to the video stream to be used forvideo of a movie, 0x1100 to 0x111F are allocated to the audio streams,0x1200 to 0x121F are allocated to the presentation graphics streams,0x1400 to 0x141F are allocated to the interactive graphics streams,0x1B00 to 0x1B1F are allocated to the video streams to be used forsecondary video of the movie, and 0x1A00 to 0x1A1F are allocated to theaudio streams to be used for the secondary audio to be mixed with theprimary audio.

FIG. 34 schematically illustrates how data is multiplexed. First, avideo stream ex235 composed of video frames and an audio stream ex238composed of audio frames are transformed into a stream of PES packetsex236 and a stream of PES packets ex239, and further into TS packetsex237 and TS packets ex240, respectively. Similarly, data of apresentation graphics stream ex241 and data of an interactive graphicsstream ex244 are transformed into a stream of PES packets ex242 and astream of PES packets ex245, and further into TS packets ex243 and TSpackets ex246, respectively. These TS packets are multiplexed into astream to obtain multiplexed data ex247.

FIG. 35 illustrates how a video stream is stored in a stream of PESpackets in more detail. The first bar in FIG. 35 shows a video framestream in a video stream. The second bar shows the stream of PESpackets. As indicated by arrows denoted as yy1, yy2, yy3, and yy4 inFIG. 35, the video stream is divided into pictures as I-pictures,B-pictures, and P-pictures each of which is a video presentation unit,and the pictures are stored in a payload of each of the PES packets.Each of the PES packets has a PES header, and the PES header stores aPresentation Time-Stamp (PTS) indicating a display time of the picture,and a Decoding Time-Stamp (DTS) indicating a decoding time of thepicture.

FIG. 36 illustrates a format of TS packets to be finally written on themultiplexed data. Each of the TS packets is a 188-byte fixed lengthpacket including a 4-byte TS header having information, such as a PIDfor identifying a stream and a 184-byte TS payload for storing data. ThePES packets are divided, and stored in the TS payloads, respectively.When a BD ROM is used, each of the TS packets is given a 4-byteTP_Extra_Header, thus resulting in 192-byte source packets. The sourcepackets are written on the multiplexed data. The TP_Extra_Header storesinformation such as an Arrival_Time_Stamp (ATS). The ATS shows atransfer start time at which each of the TS packets is to be transferredto a PID filter. The source packets are arranged in the multiplexed dataas shown at the bottom of FIG. 36. The numbers incrementing from thehead of the multiplexed data are called source packet numbers (SPNs).

Each of the TS packets included in the multiplexed data includes notonly streams of audio, video, subtitles and others, but also a ProgramAssociation Table (PAT), a Program Map Table (PMT), and a Program ClockReference (PCR). The PAT shows what a PID in a PMT used in themultiplexed data indicates, and a PID of the PAT itself is registered aszero. The PMT stores PIDs of the streams of video, audio, subtitles andothers included in the multiplexed data, and attribute information ofthe streams corresponding to the PIDs. The PMT also has variousdescriptors relating to the multiplexed data. The descriptors haveinformation such as copy control information showing whether copying ofthe multiplexed data is permitted or not. The PCR stores STC timeinformation corresponding to an ATS showing when the PCR packet istransferred to a decoder, in order to achieve synchronization between anArrival Time Clock (ATC) that is a time axis of ATSs, and an System TimeClock (STC) that is a time axis of PTSs and DTSs.

FIG. 37 illustrates the data structure of the PMT in detail. A PMTheader is disposed at the top of the PMT. The PMT header describes thelength of data included in the PMT and others. A plurality ofdescriptors relating to the multiplexed data is disposed after the PMTheader. Information such as the copy control information is described inthe descriptors. After the descriptors, a plurality of pieces of streaminformation relating to the streams included in the multiplexed data isdisposed. Each piece of stream information includes stream descriptorseach describing information, such as a stream type for identifying acompression codec of a stream, a stream PID, and stream attributeinformation (such as a frame rate or an aspect ratio). The streamdescriptors are equal in number to the number of streams in themultiplexed data.

When the multiplexed data is recorded on a recording medium and others,it is recorded together with multiplexed data information files.

Each of the multiplexed data information files is management informationof the multiplexed data as shown in FIG. 38. The multiplexed datainformation files are in one to one correspondence with the multiplexeddata, and each of the files includes multiplexed data information,stream attribute information, and an entry map.

As illustrated in FIG. 38, the multiplexed data information includes asystem rate, a reproduction start time, and a reproduction end time. Thesystem rate indicates the maximum transfer rate at which a system targetdecoder to be described later transfers the multiplexed data to a PIDfilter. The intervals of the ATSs included in the multiplexed data areset to not higher than a system rate. The reproduction start timeindicates a PTS in a video frame at the head of the multiplexed data. Aninterval of one frame is added to a PTS in a video frame at the end ofthe multiplexed data, and the PTS is set to the reproduction end time.

As shown in FIG. 39, a piece of attribute information is registered inthe stream attribute information, for each PID of each stream includedin the multiplexed data. Each piece of attribute information hasdifferent information depending on whether the corresponding stream is avideo stream, an audio stream, a presentation graphics stream, or aninteractive graphics stream. Each piece of video stream attributeinformation carries information including what kind of compression codecis used for compressing the video stream, and the resolution, aspectratio and frame rate of the pieces of picture data that is included inthe video stream. Each piece of audio stream attribute informationcarries information including what kind of compression codec is used forcompressing the audio stream, how many channels are included in theaudio stream, which language the audio stream supports, and how high thesampling frequency is. The video stream attribute information and theaudio stream attribute information are used for initialization of adecoder before the player plays back the information.

In the present embodiment, the multiplexed data to be used is of astream type included in the PMT. Furthermore, when the multiplexed datais recorded on a recording medium, the video stream attributeinformation included in the multiplexed data information is used. Morespecifically, the moving picture coding method or the moving picturecoding apparatus described in the above embodiment includes a step or aunit for allocating unique information indicating video data generatedby the moving picture coding method or the moving picture codingapparatus in the above embodiment, to the stream type included in thePMT or the video stream attribute information. With the configuration,the video data generated by the moving picture coding method or themoving picture coding apparatus described in the above embodiment can bedistinguished from video data that conforms to another standard.

Furthermore, FIG. 40 illustrates steps of the moving picture decodingmethod according to the present embodiment. In Step exS100, the streamtype included in the PMT or the video stream attribute informationincluded in the multiplexed data information is obtained from themultiplexed data. Next, in Step exS101, it is determined whether or notthe stream type or the video stream attribute information indicates thatthe multiplexed data is generated by the moving picture coding method orthe moving picture coding apparatus in the above embodiment. When it isdetermined that the stream type or the video stream attributeinformation indicates that the multiplexed data is generated by themoving picture coding method or the moving picture coding apparatus inthe above embodiment, in Step exS102, decoding is performed by themoving picture decoding method in the above embodiment. Furthermore,when the stream type or the video stream attribute information indicatesconformance to the conventional standards, such as MPEG-2, MPEG-4 AVC,and VC-1, in Step exS103, decoding is performed by a moving picturedecoding method in conformity with the conventional standards.

As such, allocating a new unique value to the stream type or the videostream attribute information enables determination whether or not themoving picture decoding method or the moving picture decoding apparatusthat is described in the above embodiment can perform decoding. Evenwhen multiplexed data that conforms to a different standard is input, anappropriate decoding method or apparatus can be selected. Thus, itbecomes possible to decode information without any error. Furthermore,the moving picture coding method or apparatus, or the moving picturedecoding method or apparatus in the present embodiment can be used inthe devices and systems described above.

Embodiment 4

Each of the moving picture coding method, the moving picture codingapparatus, the moving picture decoding method, and the moving picturedecoding apparatus in the above embodiment is typically achieved in theform of an integrated circuit or a Large Scale Integrated (LSI) circuit.As an example of the LSI, FIG. 41 illustrates a configuration of the LSIex500 that is made into one chip. The LSI ex500 includes elements ex501,ex502, ex503, ex504, ex505, ex506, ex507, ex508, and ex509 to bedescribed below, and the elements are connected to each other through abus ex510. The power supply circuit unit ex505 is activated by supplyingeach of the elements with power when the power supply circuit unit ex505is turned on.

For example, when coding is performed, the LSI ex500 receives an AVsignal from a microphone ex117, a camera ex113, and others through an AVIO ex509 under control of a control unit ex501 including a CPU ex502, amemory controller ex503, a stream controller ex504, and a drivingfrequency control unit ex512. The received AV signal is temporarilystored in an external memory ex511, such as an SDRAM. Under control ofthe control unit ex501, the stored data is segmented into data portionsaccording to the processing amount and speed to be transmitted to asignal processing unit ex507. Then, the signal processing unit ex507codes an audio signal and/or a video signal. Here, the coding of thevideo signal is the coding described in the above embodiment.Furthermore, the signal processing unit ex507 sometimes multiplexes thecoded audio data and the coded video data, and a stream IO ex506provides the multiplexed data outside. The provided multiplexed data istransmitted to the base station ex107, or written on the recordingmedium ex215. When data sets are multiplexed, the data should betemporarily stored in the buffer ex508 so that the data sets aresynchronized with each other.

Although the memory ex511 is an element outside the LSI ex500, it may beincluded in the LSI ex500. The buffer ex508 is not limited to onebuffer, but may be composed of buffers. Furthermore, the LSI ex500 maybe made into one chip or a plurality of chips.

Furthermore, although the control unit ex501 includes the CPU ex502, thememory controller ex503, the stream controller ex504, the drivingfrequency control unit ex512, the configuration of the control unitex501 is not limited to such. For example, the signal processing unitex507 may further include a CPU. Inclusion of another CPU in the signalprocessing unit ex507 can improve the processing speed. Furthermore, asanother example, the CPU ex502 may serve as or be a part of the signalprocessing unit ex507, and, for example, may include an audio signalprocessing unit. In such a case, the control unit ex501 includes thesignal processing unit ex507 or the CPU ex502 including a part of thesignal processing unit ex507.

The name used here is LSI, but it may also be called IC, system LSI,super LSI, or ultra LSI depending on the degree of integration.

Moreover, ways to achieve integration are not limited to the LSI, and aspecial circuit or a general purpose processor and so forth can alsoachieve the integration. Field Programmable Gate Array (FPGA) that canbe programmed after manufacturing LSIs or a reconfigurable processorthat allows re-configuration of the connection or configuration of anLSI can be used for the same purpose.

In the future, with advancement in semiconductor technology, a brand-newtechnology may replace LSI. The functional blocks can be integratedusing such a technology. The possibility is that the present disclosureis applied to biotechnology.

Embodiment 5

When video data generated in the moving picture coding method or by themoving picture coding apparatus described in the above embodiment isdecoded, compared to when video data that conforms to a conventionalstandard, such as MPEG-2, MPEG-4 AVC, and VC-1 is decoded, theprocessing amount probably increases. Thus, the LSI ex500 needs to beset to a driving frequency higher than that of the CPU ex502 to be usedwhen video data in conformity with the conventional standard is decoded.However, when the driving frequency is set higher, there is a problemthat the power consumption increases.

In order to solve the problem, the moving picture decoding apparatus,such as the television ex300 and the LSI ex500 is configured todetermine to which standard the video data conforms, and switch betweenthe driving frequencies according to the determined standard. FIG. 42illustrates a configuration ex800 in the present embodiment. A drivingfrequency switching unit ex803 sets a driving frequency to a higherdriving frequency when video data is generated by the moving picturecoding method or the moving picture coding apparatus described in theabove embodiment. Then, the driving frequency switching unit ex803instructs a decoding processing unit ex801 that executes the movingpicture decoding method described in the above embodiment to decode thevideo data. When the video data conforms to the conventional standard,the driving frequency switching unit ex803 sets a driving frequency to alower driving frequency than that of the video data generated by themoving picture coding method or the moving picture coding apparatusdescribed in the above embodiment. Then, the driving frequency switchingunit ex803 instructs the decoding processing unit ex802 that conforms tothe conventional standard to decode the video data.

More specifically, the driving frequency switching unit ex803 includesthe CPU ex502 and the driving frequency control unit ex512 in FIG. 41.Here, each of the decoding processing unit ex801 that executes themoving picture decoding method described in the above embodiment and thedecoding processing unit ex802 that conforms to the conventionalstandard corresponds to the signal processing unit ex507 in FIG. 41. TheCPU ex502 determines to which standard the video data conforms. Then,the driving frequency control unit ex512 determines a driving frequencybased on a signal from the CPU ex502. Furthermore, the signal processingunit ex507 decodes the video data based on the signal from the CPUex502. For example, the identification information described inEmbodiment 3 is probably used for identifying the video data. Theidentification information is not limited to the one described inEmbodiment 3 but may be any information as long as the informationindicates to which standard the video data conforms. For example, whenwhich standard video data conforms to can be determined based on anexternal signal for determining that the video data is used for atelevision or a disk, etc., the determination may be made based on suchan external signal. Furthermore, the CPU ex502 selects a drivingfrequency based on, for example, a look-up table in which the standardsof the video data are associated with the driving frequencies as shownin FIG. 44. The driving frequency can be selected by storing the look-uptable in the buffer ex508 and in an internal memory of an LSI, and withreference to the look-up table by the CPU ex502.

FIG. 43 illustrates steps for executing a method in the presentembodiment. First, in Step exS200, the signal processing unit ex507obtains identification information from the multiplexed data. Next, inStep exS201, the CPU ex502 determines whether or not the video data isgenerated by the coding method and the coding apparatus described in theabove embodiment, based on the identification information. When thevideo data is generated by the moving picture coding method and themoving picture coding apparatus described in the above embodiment, inStep exS202, the CPU ex502 transmits a signal for setting the drivingfrequency to a higher driving frequency to the driving frequency controlunit ex512. Then, the driving frequency control unit ex512 sets thedriving frequency to the higher driving frequency. On the other hand,when the identification information indicates that the video dataconforms to the conventional standard, such as MPEG-2, MPEG-4 AVC, andVC-1, in Step exS203, the CPU ex502 transmits a signal for setting thedriving frequency to a lower driving frequency to the driving frequencycontrol unit ex512. Then, the driving frequency control unit ex512 setsthe driving frequency to the lower driving frequency than that in thecase where the video data is generated by the moving picture codingmethod and the moving picture coding apparatus described in the aboveembodiment.

Furthermore, along with the switching of the driving frequencies, thepower conservation effect can be improved by changing the voltage to beapplied to the LSI ex500 or an apparatus including the LSI ex500. Forexample, when the driving frequency is set lower, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set to a voltage lower than that in the case where the drivingfrequency is set higher.

Furthermore, when the processing amount for decoding is larger, thedriving frequency may be set higher, and when the processing amount fordecoding is smaller, the driving frequency may be set lower as themethod for setting the driving frequency. Thus, the setting method isnot limited to the ones described above. For example, when theprocessing amount for decoding video data in conformity with MPEG-4 AVCis larger than the processing amount for decoding video data generatedby the moving picture coding method and the moving picture codingapparatus described in the above embodiment, the driving frequency isprobably set in reverse order to the setting described above.

Furthermore, the method for setting the driving frequency is not limitedto the method for setting the driving frequency lower. For example, whenthe identification information indicates that the video data isgenerated by the moving picture coding method and the moving picturecoding apparatus described in the above embodiment, the voltage to beapplied to the LSI ex500 or the apparatus including the LSI ex500 isprobably set higher. When the identification information indicates thatthe video data conforms to the conventional standard, such as MPEG-2,MPEG-4 AVC, and VC-1, the voltage to be applied to the LSI ex500 or theapparatus including the LSI ex500 is probably set lower. As anotherexample, when the identification information indicates that the videodata is generated by the moving picture coding method and the movingpicture coding apparatus described in the above embodiment, the drivingof the CPU ex502 does not probably have to be suspended. When theidentification information indicates that the video data conforms to theconventional standard, such as MPEG-2, MPEG-4 AVC, and VC-1, the drivingof the CPU ex502 is probably suspended at a given time because the CPUex502 has extra processing capacity. Even when the identificationinformation indicates that the video data is generated by the movingpicture coding method and the moving picture coding apparatus describedin the above embodiment, in the case where the CPU ex502 has extraprocessing capacity, the driving of the CPU ex502 is probably suspendedat a given time. In such a case, the suspending time is probably setshorter than that in the case where when the identification informationindicates that the video data conforms to the conventional standard,such as MPEG-2, MPEG-4 AVC, and VC-1.

Accordingly, the power conservation effect can be improved by switchingbetween the driving frequencies in accordance with the standard to whichthe video data conforms. Furthermore, when the LSI ex500 or theapparatus including the LSI ex500 is driven using a battery, the batterylife can be extended with the power conservation effect.

Embodiment 6

There are cases where a plurality of video data that conforms todifferent standards, is provided to the devices and systems, such as atelevision and a cellular phone. In order to enable decoding theplurality of video data that conforms to the different standards, thesignal processing unit ex507 of the LSI ex500 needs to conform to thedifferent standards. However, the problems of increase in the scale ofthe circuit of the LSI ex500 and increase in the cost arise with theindividual use of the signal processing units ex507 that conform to therespective standards.

In order to solve the problem, what is conceived is a configuration inwhich the decoding processing unit for implementing the moving picturedecoding method described in the above embodiment and the decodingprocessing unit that conforms to the conventional standard, such asMPEG-2, MPEG-4 AVC, and VC-1 are partly shared. Ex900 in FIG. 45A showsan example of the configuration. For example, the moving picturedecoding method described in the above embodiment and the moving picturedecoding method that conforms to MPEG-4 AVC have, partly in common, thedetails of processing, such as entropy coding, inverse quantization,deblocking filtering, and motion compensated prediction. The details ofprocessing to be shared probably include use of a decoding processingunit ex902 that conforms to MPEG-4 AVC. In contrast, a dedicateddecoding processing unit ex901 is probably used for other processingunique to an embodiment herein. Since an embodiment disclosed herein ischaracterized by motion compensation in particular, for example, thededicated decoding processing unit ex901 is used for motioncompensation. Otherwise, the decoding processing unit is probably sharedfor one of the entropy decoding, deblocking filtering, and inversequantization, or all of the processing. The decoding processing unit forimplementing the moving picture decoding method described in the aboveembodiment may be shared for the processing to be shared, and adedicated decoding processing unit may be used for processing unique tothat of MPEG-4 AVC.

Furthermore, ex1000 in FIG. 45B shows another example in that processingis partly shared. This example uses a configuration including adedicated decoding processing unit ex1001 that supports the processingunique to an embodiment disclosed herein, a dedicated decodingprocessing unit ex1002 that supports the processing unique to anotherconventional standard, and a decoding processing unit ex1003 thatsupports processing to be shared between the moving picture decodingmethod according to an embodiment disclosed herein and the conventionalmoving picture decoding method. Here, the dedicated decoding processingunits ex1001 and ex1002 are not necessarily specialized for theprocessing according to an embodiment disclosed herein and theprocessing of the conventional standard, respectively, and may be theones capable of implementing general processing. Furthermore, theconfiguration of the present embodiment can be implemented by the LSIex500.

As such, reducing the scale of the circuit of an LSI and reducing thecost are possible by sharing the decoding processing unit for theprocessing to be shared between the moving picture decoding methodaccording to an embodiment disclosed herein and the moving picturedecoding method in conformity with the conventional standard.

INDUSTRIAL APPLICABILITY

The image coding method and the image decoding method consistent withone or more exemplary embodiments of the present disclosure areapplicable to television receivers, digital video recorders, carnavigation systems, cellular phones, digital cameras, or digital videocameras, for example.

1. An image coding method of coding a plurality of blocks included in aplurality of pictures of an image, the image coding method comprising:(i) determining, for each of one or more associated blocks, whether ornot to add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) coding the currentblock using the merged motion vector as a motion vector of the currentblock, wherein, in the determining, it is determined that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block in codingof the associated block, the current picture being a picture includingthe current block, and the current reference picture being a picturewhich is referred to using the motion vector of the current block in thecoding of the current block.
 2. The image coding method according toclaim 1, wherein, in the determining, it is determined that the motionvector of the associated block is not to be added to the list when aview including the associated picture is different from a view includingthe associated reference picture or when a view including the currentpicture is different from a view including the current referencepicture, so as to determine that the motion vector of the associatedblock is not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current reference picture match temporally.
 3. The imagecoding method according to claim 1, wherein, in the determining, it isdetermined that the motion vector of the associated block is not to beadded to the list when a display order of the associated picture and adisplay order of the associated reference picture match or when adisplay order of the current picture and a display order of the currentreference picture match, so as to determine that the motion vector ofthe associated block is not to be added to the list when the associatedpicture and the associated reference picture match temporally or whenthe current picture and the current reference picture match temporally.4. The image coding method according to claim 1, wherein, in thedetermining, it is determined that the motion vector of the associatedblock is not to be added to the list when the associated picture and theassociated reference picture match temporally or when the currentpicture and the current associated reference picture match temporallyexcept when the associated picture and the associated reference picturematch temporally and the current picture and the current referencepicture match temporally.
 5. The image coding method according to claim1, wherein, in the determining, it is determined that the motion vectorof the associated block is not to be added to the list when only one ofthe following is true: a view including the associated picture isdifferent from a view including the associated reference picture; and aview including the current picture is different from a view includingthe current reference picture, so as to determine that the motion vectorof the associated block is not to be added to the list when theassociated picture and the associated reference picture match temporallyor when the current picture and the current reference picture matchtemporally except when the associated picture and the associatedreference picture match temporally and the current picture and thecurrent reference picture match temporally.
 6. The image coding methodaccording to claim 1, wherein, in the adding, a predetermined motionvector is added to the list when the current picture and the currentreference picture match temporally.
 7. The image coding method accordingto claim 6, wherein, in the adding, the predetermined motion vectorwhich is attached to a header of a coded stream is added to the list. 8.The image coding method according to claim 6, wherein, in the adding, adisparity vector indicating a direction and a magnitude of disparity isadded to the list as the predetermined motion vector.
 9. The imagecoding method according to claim 1, wherein, in the coding, the currentblock is coded using a motion vector resulting from motion estimation,and the motion vector resulting from the motion estimation is coded whenno motion vector is added to the list.
 10. The Image coding methodaccording to claim 1, wherein, in the adding, the motion vector of theassociated block is scaled using a ratio of a temporal distance betweenthe current picture and the current reference picture to a temporaldistance between the associated picture and the associated referencepicture, and the scaled motion vector is added to the list.
 11. An imagedecoding method of decoding a plurality of blocks included in aplurality of pictures of an image, the image decoding method comprising:(i) determining, for each of one or more associated blocks, whether ornot to add a motion vector of the associated block to a list, and (ii)adding the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; selecting, from the list, amotion vector which is to be merged to a current block that is a blockwhich is included in the plurality of blocks and is different from theone or more associated blocks; and (i) merging, to the current block,the motion vector selected in the selecting, and (ii) decoding thecurrent block using the merged motion vector as a motion vector of thecurrent block, wherein, in the determining, it is determined that themotion vector of the associated block is not to be added to the listwhen an associated picture and an associated reference picture matchtemporally or when a current picture and a current reference picturematch temporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block indecoding of the associated block, the current picture being a pictureincluding the current block, and the current reference picture being apicture which is referred to using the motion vector of the currentblock in the decoding of the current block.
 12. The image decodingmethod according to claim 11, wherein, in the determining, it isdetermined that the motion vector of the associated block is not to beadded to the list when a view including the associated picture isdifferent from a view including the associated reference picture or whena view including the current picture is different from a view includingthe current reference picture, so as to determine that the motion vectorof the associated block is not to be added to the list when theassociated picture and the associated reference picture match temporallyor when the current picture and the current reference picture matchtemporally.
 13. The Image decoding method according to claim 11,wherein, in the determining, it is determined that the motion vector ofthe associated block is not to be added to the list when a display orderof the associated picture and a display order of the associatedreference picture match or when a display order of the current pictureand a display order of the current reference picture match, so as todetermine that the motion vector of the associated block is not to beadded to the list when the associated picture and the associatedreference picture match temporally or when the current picture and thecurrent reference picture match temporally.
 14. The image decodingmethod according to claim 11, wherein, in the determining, it isdetermined that the motion vector of the associated block is not to beadded to the list when the associated picture and the associatedreference picture match temporally or when the current picture and thecurrent associated reference picture match temporally except when theassociated picture and the associated reference picture match temporallyand the current picture and the current reference picture matchtemporally.
 15. The image decoding method according to claim 11,wherein, in the determining, it is determined that the motion vector ofthe associated block is not to be added to the list when only one of thefollowing is true: a view including the associated picture is differentfrom a view including the associated reference picture; and a viewincluding the current picture is different from a view including thecurrent reference picture, so as to determine that the motion vector ofthe associated block is not to be added to the list when the associatedpicture and the associated reference picture match temporally or whenthe current picture and the current reference picture match temporallyexcept when the associated picture and the associated reference picturematch temporally and the current picture and the current referencepicture match temporally.
 16. The image decoding method according toclaim 11, wherein, in the adding, a predetermined motion vector is addedto the list when the current picture and the current reference picturematch temporally.
 17. The image decoding method according to claim 16,wherein, in the adding, the predetermined motion vector which has beenattached to a header of a coded stream is added to the list.
 18. Theimage decoding method according to claim 16, wherein, in the adding, adisparity vector indicating a direction and a magnitude of disparity isadded to the list as the predetermined motion vector.
 19. The imagedecoding method according to claim 11, wherein, in the decoding, themotion vector of the current block is decoded, and the current block isdecoded using the decoded motion vector when no motion vector is addedto the list.
 20. The image decoding method according to claim 11,wherein, in the adding, the motion vector of the associated block isscaled using a ratio of a temporal distance between the current pictureand the current reference picture to a temporal distance between theassociated picture and the associated reference picture, and the scaledmotion vector is added to the list.
 21. An image coding apparatus whichcodes a plurality of blocks included in a plurality of pictures of animage, the image coding apparatus comprising: an addition unitconfigured to (i) determine, for each of one or more associated blocks,whether or not to add a motion vector of the associated block to a list,and (ii) add the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded, the one or more associated blocks being one or more blocksincluded in the plurality of blocks; a selection unit configured toselect, from the list, a motion vector which is to be merged to acurrent block that is a block which is included in the plurality ofblocks and is different from the one or more associated blocks; and acoding unit configured to (i) merge, to the current block, the motionvector selected by the selection unit, and (ii) code the current blockusing the merged motion vector as a motion vector of the current block,wherein the addition unit is configured to determine that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block in codingof the associated block, the current picture being a picture includingthe current block, and the current reference picture being a picturewhich is referred to using the motion vector of the current block in thecoding of the current block.
 22. An image decoding apparatus whichdecodes a plurality of blocks included in a plurality of pictures of animage, the image decoding apparatus comprising: an addition unitconfigured to (i) determine, for each of one or more associated blocks,whether or not to add a motion vector of the associated block to a list,and (ii) add the motion vector of the associated block to the list whendetermining that the motion vector of the associated block is to beadded to the list, the one or more associated blocks being one or moreblocks included in the plurality of blocks; a selection unit configuredto select, from the list, a motion vector which is to be merged to acurrent block that is a block which is included in the plurality ofblocks and is different from the one or more associated blocks; and adecoding unit configured to (i) merge, to the current block, the motionvector selected by the selection unit, and (ii) decode the current blockusing the merged motion vector as a motion vector of the current block,wherein the addition unit is configured to determine that the motionvector of the associated block is not to be added to the list when anassociated picture and an associated reference picture match temporallyor when a current picture and a current reference picture matchtemporally, the associated picture being a picture including theassociated block, the associated reference picture being a picture whichis referred to using the motion vector of the associated block indecoding of the associated block, the current picture being a pictureincluding the current block, and the current reference picture being apicture which is referred to using the motion vector of the currentblock in the decoding of the current block.
 23. An image coding anddecoding apparatus comprising: the coding apparatus according to claim21; and the image decoding apparatus according to claim 22.